Jul 06 20:37:51 devstack cinder-volume[75945]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 20:37:51 devstack cinder-volume[75945]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 20:37:51 devstack cinder-volume[75945]: we strongly recommend against using it for new projects. Jul 06 20:37:51 devstack cinder-volume[75945]: If you are already using Eventlet, we recommend migrating to a different Jul 06 20:37:51 devstack cinder-volume[75945]: framework. For more detail see Jul 06 20:37:51 devstack cinder-volume[75945]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 20:37:51 devstack cinder-volume[75945]: import eventlet # noqa Jul 06 20:37:54 devstack cinder-volume[75945]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75945) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 20:37:54 devstack cinder-volume[75945]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75945) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 20:37:54 devstack cinder-volume[75945]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75945) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 20:37:55 devstack cinder-volume[75945]: INFO dbcounter [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Registered counter for database cinder Jul 06 20:37:55 devstack cinder-volume[75945]: DEBUG oslo_db.sqlalchemy.engines [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75945) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 20:37:55 devstack cinder-volume[75945]: DEBUG dbcounter [-] [75945] Writer thread running {{(pid=75945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 20:37:55 devstack cinder-volume[75945]: INFO cinder.rpc [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 20:37:55 devstack cinder-volume[75945]: INFO cinder.rpc [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 20:37:55 devstack cinder-volume[75945]: DEBUG oslo_db.sqlalchemy.engines [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75945) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 20:37:55 devstack cinder-volume[75945]: INFO cinder.volume.manager [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Determined volume DB was empty at startup. Jul 06 20:37:55 devstack cinder-volume[75945]: DEBUG cinder.volume.manager [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75945) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 20:37:55 devstack cinder-volume[75945]: INFO cinder.volume.manager [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 06 20:37:55 devstack cinder-volume[75945]: WARNING stevedore.named [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 20:37:55 devstack cinder-volume[75945]: WARNING castellan.key_manager [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 20:37:55 devstack cinder-volume[75945]: WARNING cinder.keymgr.conf_key_mgr [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 20:37:55 devstack cinder-volume[75945]: DEBUG cinder.volume.drivers.lvm [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75945) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 06 20:37:55 devstack cinder-volume[75945]: DEBUG oslo_concurrency.processutils [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_concurrency.processutils [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] CMD "cinder-rtstool verify" returned: 0 in 0.488s {{(pid=75945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_db.sqlalchemy.engines [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75945) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 20:37:56 devstack cinder-volume[75945]: INFO cinder.rpc [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 06 20:37:56 devstack cinder-volume[75945]: INFO cinder.rpc [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 06 20:37:56 devstack cinder-volume[75945]: WARNING stevedore.named [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 20:37:56 devstack cinder-volume[75945]: WARNING castellan.key_manager [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 20:37:56 devstack cinder-volume[75945]: INFO cinder.volume.manager [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_db.sqlalchemy.engines [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75945) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 20:37:56 devstack cinder-volume[75945]: INFO oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Starting 1 workers Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Started child 76121 {{(pid=75945) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Full set of CONF: {{(pid=75945) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] ******************************************************************************** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Configuration options gathered from: {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] ================================================================================ {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] allow_availability_zone_fallback = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] allow_compression_on_image_upload = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] allowed_direct_url_schemes = [] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] api_rate_limit = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] auth_strategy = keystone {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] az_cache_duration = 3600 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_availability_zone = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_host = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_name = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_stats_polling_interval = 60 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[76121]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backup_api_class = cinder.backup.api.API {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backup_name_template = backup-%s {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backup_use_same_host = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backup_use_temp_snapshot = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] chap_password = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] chap_username = {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cinder_internal_tenant_project_id = 6bee1bdc3ef6495b8a95fd0e51559845 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cinder_internal_tenant_user_id = 8f4cdb8ed0c8479d8197d29811f42111 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cloned_volume_same_az = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cluster = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] compression_format = gzip {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] compute_api_class = cinder.compute.nova.API {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] config_dir = [] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] config_source = [] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] control_exchange = openstack {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] debug = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] default_availability_zone = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] default_group_type = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] default_volume_type = lvmdriver-1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] disk_geometry = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] driver_client_cert = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] driver_client_cert_key = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] driver_data_namespace = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] driver_ssl_cert_path = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] driver_ssl_cert_verify = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] driver_use_ssl = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] enable_force_upload = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] enable_new_services = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] enable_unsupported_driver = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] enforce_multipath_for_image_xfer = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] filter_function = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance_api_insecure = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance_api_servers = ['http://192.168.122.159/image'] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance_api_ssl_compression = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance_ca_certificates_file = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance_catalog_info = image:glance:publicURL {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance_certfile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance_keyfile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance_num_retries = 3 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance_request_timeout = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] goodness_function = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] graceful_shutdown_timeout = 5 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] group_api_class = cinder.group.api.API {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] host = devstack {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] image_compress_on_upload = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] image_conversion_address_space_limit = 1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] image_conversion_cpu_limit = 60 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] image_conversion_disable = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] image_upload_use_cinder_backend = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] image_upload_use_internal_tenant = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] image_volume_cache_enabled = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] image_volume_cache_max_count = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] image_volume_cache_max_size_gb = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] init_host_max_objects_retrieval = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] instance_format = [instance: %(uuid)s] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] iscsi_target_flags = {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] iscsi_write_cache = on {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] iser_helper = tgtadm {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] iser_ip_address = 192.168.122.159 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] iser_port = 3260 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] log_color = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] log_config_append = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] log_dir = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] log_file = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] log_options = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] log_rotate_interval = 1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] log_rotate_interval_type = days {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] log_rotation_type = none {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] max_age = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] max_logfile_count = 30 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] max_logfile_size_mb = 200 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] max_over_subscription_ratio = 20.0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] message_reap_interval = 86400 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] message_ttl = 2592000 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] migration_create_volume_timeout_secs = 300 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] monkey_patch = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] monkey_patch_modules = [] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] my_ip = 192.168.122.159 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] no_snapshot_gb_quota = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] num_iser_scan_tries = 3 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] num_shell_tries = 3 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] num_volume_device_scan_tries = 3 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] nvmeof_conn_info_version = 1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] nvmet_ns_id = 10 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] nvmet_port_id = 1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] osapi_max_limit = 1000 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] osapi_volume_ext_list = [] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] osapi_volume_listen_port = 8776 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] osapi_volume_use_ssl = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] osapi_volume_workers = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] per_volume_size_limit = -1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] periodic_fuzzy_delay = 60 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] periodic_interval = 60 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] public_endpoint = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] publish_errors = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] quota_backup_gigabytes = 1000 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] quota_backups = 10 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] quota_gigabytes = 1000 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] quota_groups = 10 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] quota_snapshots = 10 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] quota_volumes = 10 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack sudo[76125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] rate_limit_burst = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] rate_limit_except_level = CRITICAL {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] rate_limit_interval = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack sudo[76125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:37:56 devstack cinder-volume[76121]: INFO cinder.volume.manager [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] reinit_driver_count = 3 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] replication_device = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] report_discard_supported = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] report_interval = 120 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] reservation_clean_interval = 86400 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] reservation_expire = 86400 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] reserved_image_namespaces = [] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] reserved_percentage = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] rpc_response_timeout = 120 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] run_external_periodic_tasks = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] scst_target_driver = iscsi {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] scst_target_iqn_name = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] service_down_time = 720 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] shell_completion = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] snapshot_name_template = snapshot-%s {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] snapshot_same_host = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] split_loggers = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] state_path = /opt/stack/data/cinder {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] storage_availability_zone = nova {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] storage_protocol = iSCSI {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] syslog_log_facility = LOG_USER {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] target_helper = lioadm {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] target_ip_address = 192.168.122.159 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] target_port = 3260 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] target_protocol = iscsi {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] target_secondary_ip_addresses = [] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] trace_flags = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] transport_url = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] until_refresh = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] use_chap_auth = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] use_default_quota_class = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] use_journal = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] use_json = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] use_multipath_for_image_xfer = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] use_stderr = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] use_syslog = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] verify_glance_signatures = enabled {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] volume_api_class = cinder.volume.api.API {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] volume_backend_name = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] volume_clear = zero {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] volume_clear_ionice = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] volume_clear_size = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] volume_copy_bps_limit = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] volume_dd_blocksize = 1M {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] volume_name_template = volume-%s {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] volume_service_inithost_offload = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] volume_usage_audit_period = month {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] zoning_mode = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_concurrency.disable_process_locking = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.auth_section = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.auth_type = password {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.auth_version = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.cache = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.certfile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.include_service_catalog = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.insecure = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.interface = public {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.keyfile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.memcache_password = {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.memcache_username = {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.region_name = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.service_type = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.159/identity {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.backend = dogpile.cache.null {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.backend_argument = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.backend_expiration_time = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.config_prefix = cache.oslo {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.debug_cache_backend = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.enable_retry_client = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.enable_socket_keepalive = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.enabled = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.expiration_time = 600 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:37:56 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.hashclient_retry_attempts = 2 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.memcache_dead_retry = 300 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.memcache_pool_maxsize = 10 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.memcache_sasl_enabled = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.password = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.proxies = [] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.redis_db = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.redis_server = localhost:6379 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.retry_attempts = 2 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.retry_delay = 0.0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.socket_keepalive_count = 1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.socket_keepalive_idle = 1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.socket_keepalive_interval = 1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.socket_timeout = 1.0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.tls_allowed_ciphers = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.tls_cafile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.tls_certfile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.tls_enabled = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.tls_keyfile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cache.username = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] coordination.backend_url = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.asyncio_connection = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.asyncio_slave_connection = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.backend = sqlalchemy {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.connection = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.connection_debug = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.connection_parameters = {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.connection_recycle_time = 3600 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.connection_trace = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.db_inc_retry_interval = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.db_max_retries = 20 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.db_max_retry_interval = 10 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.db_retry_interval = 1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.max_overflow = 50 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.max_pool_size = 5 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.max_retries = 10 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.mysql_wsrep_sync_wait = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.pool_timeout = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.retry_interval = 10 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.slave_connection = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.sqlite_synchronous = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.synchronous_reader = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] database.use_db_reconnect = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] profiler.connection_string = messaging:// {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] profiler.enabled = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] profiler.es_doc_type = notification {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] profiler.es_scroll_size = 10000 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] profiler.es_scroll_time = 2m {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:37:56 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] profiler.filter_error_trace = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] profiler.hmac_keys = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] profiler.sentinel_service_name = mymaster {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] profiler.socket_timeout = 0.1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] profiler.trace_requests = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] profiler.trace_sqlalchemy = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] profiler_jaeger.process_tags = {} {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] profiler_jaeger.service_name_prefix = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] profiler_otlp.service_name_prefix = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_policy.enforce_new_defaults = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_policy.enforce_scope = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_policy.policy_default_rule = default {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_policy.policy_file = policy.yaml {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] privsep_osbrick.group = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] privsep_osbrick.helper_command = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] privsep_osbrick.user = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cinder_sys_admin.group = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cinder_sys_admin.helper_command = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] cinder_sys_admin.user = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] service_user.auth_section = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] service_user.auth_type = password {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] service_user.cafile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] service_user.certfile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] service_user.collect_timing = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:56 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] service_user.insecure = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] service_user.keyfile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] service_user.send_service_user_token = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] service_user.split_loggers = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] service_user.timeout = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance.auth_section = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance.auth_type = password {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance.certfile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance.collect_timing = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance.insecure = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance.keyfile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance.region_name = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance.split_loggers = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] glance.timeout = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.backend_availability_zone = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.chap_password = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.chap_username = {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.disk_geometry = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.driver_client_cert = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.driver_client_cert_key = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.driver_data_namespace = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.driver_use_ssl = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.extra_capabilities = {} {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.filter_function = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.goodness_function = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.iscsi_target_flags = {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.iscsi_write_cache = on {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.iser_helper = tgtadm {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.iser_ip_address = 192.168.122.159 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.iser_port = 3260 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.lvm_share_target = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.lvm_type = auto {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.num_shell_tries = 3 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.replication_device = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.report_discard_supported = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.reserved_percentage = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.target_helper = tgtadm {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.target_ip_address = 192.168.122.159 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.target_port = 3260 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.target_protocol = iscsi {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.trace_flags = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.unique_fqdn_network = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.use_chap_auth = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.volume_backend_name = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.volume_clear = zero {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.volume_clear_ionice = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.volume_clear_size = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_reports.file_event_handler = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_reports.log_dir = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.backend_host = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.chap_password = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.chap_username = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.disk_geometry = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.driver_client_cert = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.extra_capabilities = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.filter_function = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.goodness_function = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.iser_helper = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.iser_ip_address = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.iser_port = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.lvm_share_target = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.lvm_type = auto {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.num_shell_tries = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.replication_device = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.report_discard_supported = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.reserved_percentage = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.scst_target_driver = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.storage_protocol = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.target_helper = lioadm {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.target_ip_address = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.target_port = 3260 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.trace_flags = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.use_chap_auth = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.volume_clear = zero {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.volume_clear_size = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] lvmdriver-1.volumes_dir = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.ssl = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_notifications.driver = [] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_notifications.retry = -1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] key_manager.fixed_key = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican.barbican_api_version = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican.barbican_endpoint = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican.barbican_endpoint_type = public {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican.barbican_region_name = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican.cafile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican.certfile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican.collect_timing = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican.insecure = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican.keyfile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican.number_of_retries = 60 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican.retry_delay = 1 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican.send_service_user_token = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican.split_loggers = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican.timeout = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican.verify_ssl = True {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican.verify_ssl_path = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican_service_user.auth_section = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican_service_user.auth_type = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican_service_user.cafile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican_service_user.certfile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican_service_user.collect_timing = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican_service_user.insecure = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican_service_user.keyfile = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican_service_user.split_loggers = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] barbican_service_user.timeout = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] vault.approle_role_id = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] vault.approle_secret_id = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] vault.kv_mountpoint = secret {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] vault.kv_path = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] vault.kv_version = 2 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] vault.namespace = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] vault.root_token_id = **** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] vault.ssl_ca_crt_file = None {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] vault.timeout = 60.0 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] vault.use_ssl = False {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:37:57 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] ******************************************************************************** {{(pid=75945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 20:37:57 devstack sudo[76125]: pam_unix(sudo:session): session closed for user root Jul 06 20:37:57 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.779s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:37:57 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:37:57 devstack sudo[76396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:37:57 devstack sudo[76396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:37:58 devstack sudo[76396]: pam_unix(sudo:session): session closed for user root Jul 06 20:37:58 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.698s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:37:58 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:37:58 devstack cinder-volume[76121]: INFO cinder.brick.local_dev.lvm [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 06 20:37:58 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:37:58 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:37:58 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:37:58 devstack sudo[76670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 20:37:58 devstack sudo[76670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:37:59 devstack sudo[76670]: pam_unix(sudo:session): session closed for user root Jul 06 20:37:59 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.777s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:37:59 devstack cinder-volume[76121]: DEBUG cinder.brick.local_dev.lvm [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76121) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 06 20:37:59 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:37:59 devstack sudo[76771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:37:59 devstack sudo[76771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:00 devstack sudo[76771]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:00 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.159s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:00 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:00 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:00 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:00 devstack sudo[76898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:38:00 devstack sudo[76898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:00 devstack sudo[76898]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:00 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.739s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:00 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:00 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:00 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:00 devstack sudo[76904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 06 20:38:00 devstack sudo[76904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:01 devstack sudo[76904]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:01 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.753s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:01 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:01 devstack sudo[76908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 20:38:01 devstack sudo[76908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:02 devstack sudo[76908]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:02 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.722s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:02 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:02 devstack sudo[76914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 20:38:02 devstack sudo[76914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:03 devstack sudo[76914]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:03 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.771s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:03 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:03 devstack sudo[76925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:38:03 devstack sudo[76925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:03 devstack sudo[76925]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:03 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.750s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:03 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:04 devstack sudo[76929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:38:04 devstack sudo[76929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:04 devstack sudo[76929]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:04 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.708s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:04 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:04 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:04 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:04 devstack sudo[76936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:38:04 devstack sudo[76936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:05 devstack sudo[76936]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:05 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.830s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:05 devstack cinder-volume[76121]: INFO cinder.volume.drivers.lvm [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 06 20:38:05 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:05 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:05 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:05 devstack sudo[77057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:38:05 devstack sudo[77057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:06 devstack sudo[77057]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:06 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.654s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:06 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 20:38:06 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:06 devstack sudo[77061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 20:38:06 devstack sudo[77061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:06 devstack cinder-volume[75945]: DEBUG dbcounter [-] [75945] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:38:06 devstack sudo[77061]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:06 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:06 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:06 devstack sudo[77206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:38:06 devstack sudo[77206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:07 devstack sudo[77206]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:07 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:07 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:07 devstack sudo[77209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:38:07 devstack sudo[77209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:08 devstack sudo[77209]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:08 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.638s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:08 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:08 devstack sudo[77213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:38:08 devstack sudo[77213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:08 devstack sudo[77213]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:08 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:08 devstack cinder-volume[76121]: INFO cinder.volume.driver [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Driver hasn't implemented _init_vendor_properties() Jul 06 20:38:08 devstack cinder-volume[76121]: DEBUG cinder.volume.driver [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76121) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 20:38:08 devstack cinder-volume[76121]: DEBUG oslo_db.sqlalchemy.engines [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76121) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 20:38:08 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writer thread running {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 20:38:08 devstack cinder-volume[76121]: DEBUG cinder.db.api [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Building query based on filter {{(pid=76121) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 20:38:08 devstack cinder-volume[76121]: DEBUG cinder.image.image_utils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76121) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 20:38:08 devstack cinder-volume[76121]: INFO cinder.keymgr.migration [None req-7b4d2123-cdea-4152-b52c-a31978f8ac5d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 20:38:08 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 20:38:08 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:08 devstack sudo[77218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 20:38:08 devstack sudo[77218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:09 devstack sudo[77218]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:09 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:09 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:09 devstack sudo[77221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:38:09 devstack sudo[77221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:10 devstack sudo[77221]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:10 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.695s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:10 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:10 devstack sudo[77228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:38:10 devstack sudo[77228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:10 devstack sudo[77228]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:10 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.674s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:10 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:10 devstack sudo[77232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:38:10 devstack sudo[77232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:11 devstack sudo[77232]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:11 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:11 devstack cinder-volume[76121]: DEBUG cinder.manager [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Notifying Schedulers of capabilities ... {{(pid=76121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:38:11 devstack cinder-volume[76121]: INFO cinder.volume.manager [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Driver initialization completed successfully. Jul 06 20:38:11 devstack cinder-volume[76121]: INFO cinder.manager [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Initiating service 2 cleanup Jul 06 20:38:11 devstack cinder-volume[76121]: INFO cinder.manager [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Service 2 cleanup completed. Jul 06 20:38:11 devstack cinder-volume[76121]: DEBUG cinder.service [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Creating RPC server for service cinder-volume {{(pid=76121) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 20:38:11 devstack cinder-volume[76121]: DEBUG cinder.service [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76121) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 20:38:11 devstack cinder-volume[76121]: INFO cinder.volume.manager [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 06 20:38:11 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 20:38:11 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:11 devstack sudo[77236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 20:38:11 devstack sudo[77236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:12 devstack sudo[77236]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:12 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.714s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:12 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:12 devstack sudo[77239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:38:12 devstack sudo[77239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:13 devstack sudo[77239]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:13 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.683s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:13 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:13 devstack sudo[77296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:38:13 devstack sudo[77296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:13 devstack sudo[77296]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:13 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:13 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:38:13 devstack sudo[77302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:38:13 devstack sudo[77302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:38:14 devstack sudo[77302]: pam_unix(sudo:session): session closed for user root Jul 06 20:38:14 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:38:14 devstack cinder-volume[76121]: INFO cinder.volume.manager [None req-167f291b-80a2-4b41-b0e7-6f3c57b9d1f6 None None] Driver post RPC initialization completed successfully. Jul 06 20:38:23 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running periodic task VolumeManager._thread_info {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:38:23 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] thread count: 6 {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:38:23 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] thread info: [<_MainThread(MainThread, started 132395855007872)>, , , , , ] {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:38:24 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writing DB stats cinder:SELECT=3 {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:38:24 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:39:23 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:39:23 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 20:39:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:39:23 devstack sudo[79337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 20:39:23 devstack sudo[79337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:39:24 devstack sudo[79337]: pam_unix(sudo:session): session closed for user root Jul 06 20:39:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:39:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:39:24 devstack sudo[79356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:39:24 devstack sudo[79356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:39:24 devstack sudo[79356]: pam_unix(sudo:session): session closed for user root Jul 06 20:39:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:39:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:39:24 devstack sudo[79361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:39:24 devstack sudo[79361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:39:25 devstack sudo[79361]: pam_unix(sudo:session): session closed for user root Jul 06 20:39:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:39:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:39:25 devstack sudo[79496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:39:25 devstack sudo[79496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:39:26 devstack sudo[79496]: pam_unix(sudo:session): session closed for user root Jul 06 20:39:26 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:39:26 devstack cinder-volume[76121]: DEBUG cinder.manager [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Notifying Schedulers of capabilities ... {{(pid=76121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:39:26 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running periodic task VolumeManager._thread_info {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:39:26 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] thread count: 6 {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:39:26 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] thread info: [<_MainThread(MainThread, started 132395855007872)>, , , , , ] {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:40:23 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:40:23 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 20:40:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:40:23 devstack sudo[82561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 20:40:23 devstack sudo[82561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:40:24 devstack sudo[82561]: pam_unix(sudo:session): session closed for user root Jul 06 20:40:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:40:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:40:24 devstack sudo[82565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:40:24 devstack sudo[82565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:40:24 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writing DB stats cinder:SELECT=1 {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:40:24 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writing DB stats cinder:UPDATE=1 {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:40:24 devstack sudo[82565]: pam_unix(sudo:session): session closed for user root Jul 06 20:40:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:40:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:40:24 devstack sudo[82569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:40:24 devstack sudo[82569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:40:25 devstack sudo[82569]: pam_unix(sudo:session): session closed for user root Jul 06 20:40:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.612s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:40:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:40:25 devstack sudo[82577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:40:25 devstack sudo[82577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:40:25 devstack sudo[82577]: pam_unix(sudo:session): session closed for user root Jul 06 20:40:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:40:25 devstack cinder-volume[76121]: DEBUG cinder.manager [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Notifying Schedulers of capabilities ... {{(pid=76121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:40:25 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running periodic task VolumeManager._thread_info {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:40:25 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] thread count: 6 {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:40:25 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] thread info: [<_MainThread(MainThread, started 132395855007872)>, , , , , ] {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:41:23 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:41:23 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 20:41:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:41:23 devstack sudo[84546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 20:41:23 devstack sudo[84546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:41:24 devstack sudo[84546]: pam_unix(sudo:session): session closed for user root Jul 06 20:41:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:41:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:41:24 devstack sudo[84550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:41:24 devstack sudo[84550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:41:24 devstack sudo[84550]: pam_unix(sudo:session): session closed for user root Jul 06 20:41:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:41:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:41:24 devstack sudo[84572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:41:24 devstack sudo[84572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:41:25 devstack sudo[84572]: pam_unix(sudo:session): session closed for user root Jul 06 20:41:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.627s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:41:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:41:25 devstack sudo[84600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:41:25 devstack sudo[84600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:41:26 devstack sudo[84600]: pam_unix(sudo:session): session closed for user root Jul 06 20:41:26 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.801s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:41:26 devstack cinder-volume[76121]: DEBUG cinder.manager [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Notifying Schedulers of capabilities ... {{(pid=76121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:41:26 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running periodic task VolumeManager._thread_info {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:41:26 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] thread count: 6 {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:41:26 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] thread info: [<_MainThread(MainThread, started 132395855007872)>, , , , , ] {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:42:23 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:42:23 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 20:42:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:42:23 devstack sudo[85852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 20:42:23 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:42:24 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root Jul 06 20:42:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:42:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:42:24 devstack sudo[85856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:42:24 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:42:24 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writing DB stats cinder:SELECT=1 {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:42:24 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writing DB stats cinder:UPDATE=1 {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:42:24 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root Jul 06 20:42:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:42:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:42:24 devstack sudo[85870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:42:24 devstack sudo[85870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:42:25 devstack sudo[85870]: pam_unix(sudo:session): session closed for user root Jul 06 20:42:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.632s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:42:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:42:25 devstack sudo[85896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:42:25 devstack sudo[85896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:42:25 devstack sudo[85896]: pam_unix(sudo:session): session closed for user root Jul 06 20:42:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:42:25 devstack cinder-volume[76121]: DEBUG cinder.manager [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Notifying Schedulers of capabilities ... {{(pid=76121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:42:25 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] Running periodic task VolumeManager._thread_info {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:42:25 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] thread count: 6 {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:42:25 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-c391d418-81d2-4923-ae85-a3b1af8f50c1 None None] thread info: [<_MainThread(MainThread, started 132395855007872)>, , , , , ] {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:42:32 devstack cinder-volume[75945]: INFO oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Caught SIGTERM, stopping children Jul 06 20:42:32 devstack cinder-volume[75945]: DEBUG oslo_concurrency.lockutils [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Acquiring lock "singleton_lock" {{(pid=75945) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 20:42:32 devstack cinder-volume[75945]: DEBUG oslo_concurrency.lockutils [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Acquired lock "singleton_lock" {{(pid=75945) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 20:42:32 devstack cinder-volume[75945]: DEBUG oslo_concurrency.lockutils [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Releasing lock "singleton_lock" {{(pid=75945) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 20:42:32 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Stop services. {{(pid=75945) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 06 20:42:32 devstack cinder-volume[75945]: DEBUG oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Killing children. {{(pid=75945) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 06 20:42:32 devstack cinder-volume[75945]: INFO oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Waiting on 1 children to exit Jul 06 20:42:36 devstack cinder-volume[76121]: DEBUG oslo_concurrency.lockutils [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Acquiring lock "singleton_lock" {{(pid=76121) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 20:42:36 devstack cinder-volume[76121]: DEBUG oslo_concurrency.lockutils [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Acquired lock "singleton_lock" {{(pid=76121) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 20:42:36 devstack cinder-volume[76121]: DEBUG oslo_concurrency.lockutils [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Releasing lock "singleton_lock" {{(pid=76121) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 20:42:36 devstack cinder-volume[76121]: WARNING amqp [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 20:42:36 devstack cinder-volume[76121]: WARNING amqp [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 20:42:36 devstack cinder-volume[75945]: INFO oslo_service.backend._eventlet.service [None req-2587be07-6693-4cdb-a07c-91d051422561 None None] Child 76121 exited with status 0 Jul 06 20:42:37 devstack cinder-volume[86245]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 20:42:37 devstack cinder-volume[86245]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 20:42:37 devstack cinder-volume[86245]: we strongly recommend against using it for new projects. Jul 06 20:42:37 devstack cinder-volume[86245]: If you are already using Eventlet, we recommend migrating to a different Jul 06 20:42:37 devstack cinder-volume[86245]: framework. For more detail see Jul 06 20:42:37 devstack cinder-volume[86245]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 20:42:37 devstack cinder-volume[86245]: import eventlet # noqa Jul 06 20:42:39 devstack cinder-volume[86245]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 20:42:39 devstack cinder-volume[86245]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 20:42:39 devstack cinder-volume[86245]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 20:42:39 devstack cinder-volume[86245]: INFO dbcounter [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Registered counter for database cinder Jul 06 20:42:39 devstack cinder-volume[86245]: DEBUG oslo_db.sqlalchemy.engines [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG dbcounter [-] [86245] Writer thread running {{(pid=86245) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 20:42:40 devstack cinder-volume[86245]: INFO cinder.rpc [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 20:42:40 devstack cinder-volume[86245]: INFO cinder.rpc [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_db.sqlalchemy.engines [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 20:42:40 devstack cinder-volume[86245]: INFO cinder.volume.manager [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Determined volume DB was empty at startup. Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG cinder.volume.manager [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86245) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 20:42:40 devstack cinder-volume[86245]: INFO cinder.volume.manager [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 06 20:42:40 devstack cinder-volume[86245]: WARNING stevedore.named [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 20:42:40 devstack cinder-volume[86245]: WARNING castellan.key_manager [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 20:42:40 devstack cinder-volume[86245]: WARNING cinder.keymgr.conf_key_mgr [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 20:42:40 devstack cinder-volume[86245]: INFO cinder.volume.manager [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_db.sqlalchemy.engines [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 20:42:40 devstack cinder-volume[86245]: INFO oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Starting 1 workers Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Started child 86464 {{(pid=86245) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Full set of CONF: {{(pid=86245) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] ******************************************************************************** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Configuration options gathered from: {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] ================================================================================ {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] allow_availability_zone_fallback = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] allow_compression_on_image_upload = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] allowed_direct_url_schemes = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] api_rate_limit = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] auth_strategy = keystone {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_availability_zone = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_host = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86464]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_stats_polling_interval = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backup_api_class = cinder.backup.api.API {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backup_name_template = backup-%s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backup_use_same_host = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backup_use_temp_snapshot = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] chap_password = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] chap_username = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cinder_internal_tenant_project_id = 6bee1bdc3ef6495b8a95fd0e51559845 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cinder_internal_tenant_user_id = 8f4cdb8ed0c8479d8197d29811f42111 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cluster = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] compression_format = gzip {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] compute_api_class = cinder.compute.nova.API {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] config_dir = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] config_source = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] control_exchange = openstack {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] debug = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] default_availability_zone = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] default_group_type = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] default_volume_type = QuobyteHD {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] disk_geometry = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] driver_client_cert = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] driver_client_cert_key = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] driver_data_namespace = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] driver_ssl_cert_path = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] driver_ssl_cert_verify = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] driver_use_ssl = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] enable_new_services = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] enable_unsupported_driver = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] enabled_backends = ['QuobyteHD'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] enforce_multipath_for_image_xfer = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] filter_function = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance_api_insecure = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance_api_servers = ['http://192.168.122.159/image'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance_api_ssl_compression = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance_ca_certificates_file = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance_catalog_info = image:glance:publicURL {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance_certfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance_keyfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance_num_retries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance_request_timeout = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] goodness_function = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] graceful_shutdown_timeout = 5 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] group_api_class = cinder.group.api.API {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] host = devstack {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] image_compress_on_upload = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] image_conversion_address_space_limit = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] image_conversion_cpu_limit = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] image_conversion_disable = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] image_upload_use_cinder_backend = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] image_upload_use_internal_tenant = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] image_volume_cache_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] image_volume_cache_max_count = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] image_volume_cache_max_size_gb = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] init_host_max_objects_retrieval = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] instance_format = [instance: %(uuid)s] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] iscsi_target_flags = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] iscsi_write_cache = on {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] iser_helper = tgtadm {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] iser_ip_address = 192.168.122.159 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] iser_port = 3260 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] log_color = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] log_config_append = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] log_dir = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] log_file = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] log_options = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] log_rotate_interval = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] log_rotate_interval_type = days {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] log_rotation_type = none {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] max_age = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] max_logfile_count = 30 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] max_logfile_size_mb = 200 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] max_over_subscription_ratio = 20.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] message_reap_interval = 86400 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] message_ttl = 2592000 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] migration_create_volume_timeout_secs = 300 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] monkey_patch = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] monkey_patch_modules = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] my_ip = 192.168.122.159 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] no_snapshot_gb_quota = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] num_iser_scan_tries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] num_shell_tries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] num_volume_device_scan_tries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] nvmeof_conn_info_version = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] nvmet_ns_id = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] nvmet_port_id = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] osapi_max_limit = 1000 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] osapi_volume_ext_list = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] osapi_volume_listen_port = 8776 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] osapi_volume_use_ssl = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] osapi_volume_workers = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] per_volume_size_limit = -1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] periodic_fuzzy_delay = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] periodic_interval = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] public_endpoint = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] publish_errors = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] quota_backup_gigabytes = 1000 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] quota_backups = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] quota_gigabytes = 1000 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] quota_groups = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] quota_snapshots = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] quota_volumes = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] rate_limit_burst = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] rate_limit_except_level = CRITICAL {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] rate_limit_interval = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] reinit_driver_count = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] replication_device = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] report_discard_supported = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] report_interval = 120 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] reservation_clean_interval = 86400 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] reservation_expire = 86400 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] reserved_image_namespaces = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] reserved_percentage = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] rpc_response_timeout = 120 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] run_external_periodic_tasks = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] scst_target_driver = iscsi {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] scst_target_iqn_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] service_down_time = 720 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] shell_completion = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] snapshot_name_template = snapshot-%s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] split_loggers = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] state_path = /opt/stack/data/cinder {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] storage_availability_zone = nova {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] storage_protocol = iSCSI {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] syslog_log_facility = LOG_USER {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] target_helper = lioadm {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] target_ip_address = 192.168.122.159 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] target_port = 3260 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] target_protocol = iscsi {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] target_secondary_ip_addresses = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] trace_flags = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] transport_url = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] until_refresh = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] use_chap_auth = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] use_default_quota_class = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] use_journal = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] use_json = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] use_multipath_for_image_xfer = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] use_stderr = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] use_syslog = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] verify_glance_signatures = enabled {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] volume_api_class = cinder.volume.api.API {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] volume_backend_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] volume_clear = zero {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] volume_clear_ionice = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] volume_clear_size = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] volume_copy_bps_limit = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] volume_dd_blocksize = 1M {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] volume_name_template = volume-%s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] volume_service_inithost_offload = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] volume_usage_audit_period = month {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] zoning_mode = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_concurrency.disable_process_locking = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.auth_section = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.auth_type = password {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.auth_version = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.cache = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.certfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.include_service_catalog = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.insecure = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86464]: INFO cinder.volume.manager [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Starting volume driver QuobyteDriver (1.1.14) Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.interface = public {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86464]: DEBUG cinder.volume.drivers.remotefs [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86464) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.keyfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.memcache_password = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.memcache_username = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.region_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.service_type = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.159/identity {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.backend = dogpile.cache.null {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.backend_argument = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.backend_expiration_time = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.config_prefix = cache.oslo {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.debug_cache_backend = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.enable_retry_client = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.enable_socket_keepalive = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.expiration_time = 600 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.hashclient_retry_attempts = 2 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.memcache_dead_retry = 300 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.memcache_pool_maxsize = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.memcache_sasl_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.password = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.proxies = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.redis_db = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.redis_server = localhost:6379 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.retry_attempts = 2 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.retry_delay = 0.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.socket_keepalive_count = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.socket_keepalive_idle = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.socket_keepalive_interval = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.socket_timeout = 1.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.tls_allowed_ciphers = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.tls_cafile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.tls_certfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.tls_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.tls_keyfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cache.username = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] coordination.backend_url = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.asyncio_connection = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.asyncio_slave_connection = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.backend = sqlalchemy {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.connection = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.connection_debug = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.connection_parameters = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.connection_recycle_time = 3600 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.connection_trace = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.db_inc_retry_interval = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.db_max_retries = 20 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.db_max_retry_interval = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.db_retry_interval = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.max_overflow = 50 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.max_pool_size = 5 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.max_retries = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.mysql_wsrep_sync_wait = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.pool_timeout = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.retry_interval = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.slave_connection = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.sqlite_synchronous = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.synchronous_reader = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] database.use_db_reconnect = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] profiler.connection_string = messaging:// {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] profiler.enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] profiler.es_doc_type = notification {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] profiler.es_scroll_size = 10000 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] profiler.es_scroll_time = 2m {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] profiler.filter_error_trace = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] profiler.hmac_keys = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] profiler.sentinel_service_name = mymaster {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] profiler.socket_timeout = 0.1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] profiler.trace_requests = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] profiler.trace_sqlalchemy = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] profiler_jaeger.process_tags = {} {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] profiler_jaeger.service_name_prefix = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] profiler_otlp.service_name_prefix = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_policy.enforce_new_defaults = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_policy.enforce_scope = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_policy.policy_default_rule = default {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_policy.policy_file = policy.yaml {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] privsep_osbrick.group = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] privsep_osbrick.helper_command = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] privsep_osbrick.user = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cinder_sys_admin.group = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cinder_sys_admin.helper_command = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] cinder_sys_admin.user = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] service_user.auth_section = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] service_user.auth_type = password {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] service_user.cafile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] service_user.certfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] service_user.collect_timing = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] service_user.insecure = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] service_user.keyfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] service_user.send_service_user_token = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] service_user.split_loggers = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] service_user.timeout = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance.auth_section = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance.auth_type = password {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance.certfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance.collect_timing = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance.insecure = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance.keyfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance.region_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance.split_loggers = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] glance.timeout = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.backend_availability_zone = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.chap_password = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.chap_username = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.disk_geometry = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.driver_client_cert = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.driver_client_cert_key = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.driver_data_namespace = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.driver_use_ssl = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.extra_capabilities = {} {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.filter_function = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.goodness_function = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.iscsi_target_flags = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.iscsi_write_cache = on {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.iser_helper = tgtadm {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.iser_ip_address = 192.168.122.159 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.iser_port = 3260 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.nas_host = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.nas_login = admin {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.nas_mount_options = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.nas_password = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.nas_private_key = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.nas_share_path = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.num_shell_tries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.quobyte_volume_url = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.replication_device = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.report_discard_supported = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.reserved_percentage = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.target_helper = tgtadm {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.target_ip_address = 192.168.122.159 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.target_port = 3260 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.target_protocol = iscsi {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.trace_flags = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.unique_fqdn_network = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.use_chap_auth = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.volume_backend_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.volume_clear = zero {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.volume_clear_ionice = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.volume_clear_size = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_reports.file_event_handler = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_reports.log_dir = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.backend_availability_zone = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.backend_host = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.chap_password = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.chap_username = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.chiscsi_conf = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.disk_geometry = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.driver_client_cert = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.driver_data_namespace = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.driver_use_ssl = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.extra_capabilities = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.filter_function = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.goodness_function = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.iser_helper = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.iser_ip_address = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.iser_port = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.iser_target_prefix = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.nas_host = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.nas_login = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.nas_mount_options = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.nas_password = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.nas_private_key = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.nas_share_path = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.nas_ssh_port = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.num_shell_tries = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.nvmet_port_id = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.replication_device = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.report_discard_supported = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.reserved_percentage = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.scst_target_driver = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.storage_protocol = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.target_helper = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.target_ip_address = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.target_port = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.target_prefix = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.target_protocol = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.trace_flags = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.use_chap_auth = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.volume_clear = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.volume_clear_size = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] QuobyteHD.volumes_dir = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.ssl = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_notifications.driver = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_notifications.retry = -1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] key_manager.fixed_key = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican.barbican_api_version = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican.barbican_endpoint = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican.barbican_endpoint_type = public {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican.barbican_region_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican.cafile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican.certfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican.collect_timing = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican.insecure = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican.keyfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican.number_of_retries = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican.retry_delay = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican.send_service_user_token = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican.split_loggers = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican.timeout = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican.verify_ssl = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican.verify_ssl_path = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican_service_user.auth_section = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican_service_user.auth_type = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican_service_user.cafile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican_service_user.certfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican_service_user.collect_timing = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican_service_user.insecure = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican_service_user.keyfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican_service_user.split_loggers = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] barbican_service_user.timeout = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] vault.approle_role_id = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] vault.approle_secret_id = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] vault.kv_mountpoint = secret {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] vault.kv_path = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] vault.kv_version = 2 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] vault.namespace = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] vault.root_token_id = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] vault.ssl_ca_crt_file = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] vault.timeout = 60.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] vault.use_ssl = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:42:40 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] ******************************************************************************** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 20:42:40 devstack cinder-volume[86464]: DEBUG cinder.volume.drivers.quobyte [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86464) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 06 20:42:40 devstack cinder-volume[86464]: WARNING cinder.volume.drivers.quobyte [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 06 20:42:40 devstack cinder-volume[86464]: WARNING cinder.volume.drivers.quobyte [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 06 20:42:40 devstack cinder-volume[86464]: DEBUG oslo_concurrency.processutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Running cmd (subprocess): mount.quobyte {{(pid=86464) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:42:40 devstack quobyte-client[86469]: Reading configuration file: /etc/quobyte/client.cfg Jul 06 20:42:40 devstack quobyte-client[86469]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 06 20:42:40 devstack cinder-volume[86464]: DEBUG oslo_concurrency.processutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] CMD "mount.quobyte" returned: 1 in 0.077s {{(pid=86464) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:42:40 devstack cinder-volume[86464]: DEBUG oslo_concurrency.lockutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86464) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:42:40 devstack cinder-volume[86464]: DEBUG oslo_concurrency.lockutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86464) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:42:40 devstack cinder-volume[86464]: DEBUG cinder.volume.drivers.quobyte [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=86464) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:42:40 devstack cinder-volume[86464]: INFO cinder.volume.drivers.quobyte [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 ... Jul 06 20:42:40 devstack cinder-volume[86464]: DEBUG oslo_concurrency.processutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb -c /etc/quobyte/client-cinder.cfg {{(pid=86464) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:42:40 devstack sudo[86470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb -c /etc/quobyte/client-cinder.cfg Jul 06 20:42:40 devstack sudo[86470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:42:41 devstack sudo[86470]: pam_unix(sudo:session): session closed for user root Jul 06 20:42:41 devstack cinder-volume[86464]: DEBUG oslo_concurrency.processutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.757s {{(pid=86464) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:42:41 devstack cinder-volume[86464]: INFO cinder.volume.drivers.quobyte [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 succeeded Jul 06 20:42:41 devstack cinder-volume[86464]: DEBUG cinder.volume.drivers.quobyte [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=86464) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:42:41 devstack cinder-volume[86464]: DEBUG oslo_concurrency.lockutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.767s {{(pid=86464) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:42:41 devstack cinder-volume[86464]: DEBUG oslo_concurrency.processutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=86464) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:42:41 devstack sudo[86539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:42:41 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:42:42 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root Jul 06 20:42:42 devstack cinder-volume[86464]: DEBUG oslo_concurrency.processutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.616s {{(pid=86464) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:42:42 devstack cinder-volume[86464]: INFO cinder.volume.driver [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Driver hasn't implemented _init_vendor_properties() Jul 06 20:42:42 devstack cinder-volume[86464]: DEBUG cinder.volume.driver [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86464) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 20:42:42 devstack cinder-volume[86464]: DEBUG oslo_db.sqlalchemy.engines [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86464) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 20:42:42 devstack cinder-volume[86464]: DEBUG dbcounter [-] [86464] Writer thread running {{(pid=86464) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 20:42:42 devstack cinder-volume[86464]: DEBUG cinder.db.api [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Building query based on filter {{(pid=86464) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 20:42:42 devstack cinder-volume[86464]: DEBUG cinder.image.image_utils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86464) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 20:42:42 devstack cinder-volume[86464]: INFO cinder.keymgr.migration [None req-c6ce9dde-2f7a-4e35-a7f6-8dc4c6a335b0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 20:42:42 devstack cinder-volume[86464]: DEBUG oslo_concurrency.lockutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86464) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:42:42 devstack cinder-volume[86464]: DEBUG oslo_concurrency.lockutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86464) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:42:42 devstack cinder-volume[86464]: DEBUG cinder.volume.drivers.quobyte [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=86464) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:42:42 devstack cinder-volume[86464]: DEBUG cinder.volume.drivers.quobyte [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=86464) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:42:42 devstack cinder-volume[86464]: DEBUG oslo_concurrency.lockutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86464) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:42:42 devstack cinder-volume[86464]: DEBUG oslo_concurrency.processutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=86464) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:42:42 devstack sudo[86544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:42:42 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:42:43 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root Jul 06 20:42:43 devstack cinder-volume[86464]: DEBUG oslo_concurrency.processutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.647s {{(pid=86464) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:42:43 devstack cinder-volume[86464]: DEBUG cinder.manager [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Notifying Schedulers of capabilities ... {{(pid=86464) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:42:43 devstack cinder-volume[86464]: INFO cinder.volume.manager [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Driver initialization completed successfully. Jul 06 20:42:43 devstack cinder-volume[86464]: INFO cinder.manager [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Initiating service 3 cleanup Jul 06 20:42:43 devstack cinder-volume[86464]: INFO cinder.manager [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Service 3 cleanup completed. Jul 06 20:42:43 devstack cinder-volume[86464]: DEBUG cinder.service [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Creating RPC server for service cinder-volume {{(pid=86464) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 20:42:43 devstack cinder-volume[86464]: DEBUG cinder.service [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86464) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 20:42:43 devstack cinder-volume[86464]: INFO cinder.volume.manager [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 06 20:42:43 devstack cinder-volume[86464]: DEBUG oslo_concurrency.lockutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86464) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:42:43 devstack cinder-volume[86464]: DEBUG oslo_concurrency.lockutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86464) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:42:43 devstack cinder-volume[86464]: DEBUG cinder.volume.drivers.quobyte [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=86464) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:42:43 devstack cinder-volume[86464]: DEBUG cinder.volume.drivers.quobyte [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=86464) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:42:43 devstack cinder-volume[86464]: DEBUG oslo_concurrency.lockutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86464) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:42:43 devstack cinder-volume[86464]: DEBUG oslo_concurrency.processutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=86464) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:42:43 devstack sudo[86561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:42:43 devstack sudo[86561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:42:44 devstack sudo[86561]: pam_unix(sudo:session): session closed for user root Jul 06 20:42:44 devstack cinder-volume[86464]: DEBUG oslo_concurrency.processutils [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.913s {{(pid=86464) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:42:44 devstack cinder-volume[86464]: INFO cinder.volume.manager [None req-7a6bd54a-6fa3-460e-bf74-98ef2b740e0e None None] Driver post RPC initialization completed successfully. Jul 06 20:42:48 devstack cinder-volume[86464]: DEBUG oslo_concurrency.lockutils [None req-906b2e31-ae93-4744-bc6a-e50f8dc7cb1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86464) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:42:48 devstack cinder-volume[86464]: DEBUG oslo_concurrency.lockutils [None req-906b2e31-ae93-4744-bc6a-e50f8dc7cb1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86464) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:42:48 devstack cinder-volume[86464]: DEBUG cinder.volume.drivers.quobyte [None req-906b2e31-ae93-4744-bc6a-e50f8dc7cb1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=86464) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:42:48 devstack cinder-volume[86464]: DEBUG cinder.volume.drivers.quobyte [None req-906b2e31-ae93-4744-bc6a-e50f8dc7cb1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=86464) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:42:48 devstack cinder-volume[86464]: DEBUG oslo_concurrency.lockutils [None req-906b2e31-ae93-4744-bc6a-e50f8dc7cb1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86464) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:42:48 devstack cinder-volume[86464]: DEBUG oslo_concurrency.processutils [None req-906b2e31-ae93-4744-bc6a-e50f8dc7cb1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=86464) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:42:48 devstack sudo[86770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:42:48 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:42:49 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root Jul 06 20:42:49 devstack cinder-volume[86464]: DEBUG oslo_concurrency.processutils [None req-906b2e31-ae93-4744-bc6a-e50f8dc7cb1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.613s {{(pid=86464) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:42:49 devstack cinder-volume[86464]: DEBUG cinder.manager [None req-906b2e31-ae93-4744-bc6a-e50f8dc7cb1a None None] Notifying Schedulers of capabilities ... {{(pid=86464) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:42:50 devstack cinder-volume[86245]: DEBUG dbcounter [-] [86245] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86245) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:42:51 devstack cinder-volume[86245]: INFO oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Caught SIGTERM, stopping children Jul 06 20:42:51 devstack cinder-volume[86245]: DEBUG oslo_concurrency.lockutils [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Acquiring lock "singleton_lock" {{(pid=86245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 20:42:51 devstack cinder-volume[86245]: DEBUG oslo_concurrency.lockutils [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Acquired lock "singleton_lock" {{(pid=86245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 20:42:51 devstack cinder-volume[86245]: DEBUG oslo_concurrency.lockutils [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Releasing lock "singleton_lock" {{(pid=86245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 20:42:51 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Stop services. {{(pid=86245) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 06 20:42:51 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Killing children. {{(pid=86245) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 06 20:42:51 devstack cinder-volume[86245]: INFO oslo_service.backend._eventlet.service [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Waiting on 1 children to exit Jul 06 20:42:53 devstack cinder-volume[86464]: DEBUG dbcounter [-] [86464] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86464) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:42:54 devstack cinder-volume[86464]: DEBUG dbcounter [-] [86464] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=86464) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:42:56 devstack cinder-volume[86464]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 06 20:42:56 devstack cinder-volume[86464]: DEBUG oslo_concurrency.lockutils [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Acquiring lock "singleton_lock" {{(pid=86464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 20:42:56 devstack cinder-volume[86464]: DEBUG oslo_concurrency.lockutils [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Acquired lock "singleton_lock" {{(pid=86464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 20:42:56 devstack cinder-volume[86464]: DEBUG oslo_concurrency.lockutils [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Releasing lock "singleton_lock" {{(pid=86464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 20:42:56 devstack cinder-volume[86962]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 20:42:56 devstack cinder-volume[86962]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 20:42:56 devstack cinder-volume[86962]: we strongly recommend against using it for new projects. Jul 06 20:42:56 devstack cinder-volume[86962]: If you are already using Eventlet, we recommend migrating to a different Jul 06 20:42:56 devstack cinder-volume[86962]: framework. For more detail see Jul 06 20:42:56 devstack cinder-volume[86962]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 20:42:56 devstack cinder-volume[86962]: import eventlet # noqa Jul 06 20:42:56 devstack cinder-volume[86464]: WARNING amqp [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 20:42:56 devstack cinder-volume[86464]: WARNING amqp [None req-b9d2425c-b0f2-4c07-92b6-530c68eb3082 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 20:42:59 devstack cinder-volume[86962]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86962) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 20:42:59 devstack cinder-volume[86962]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86962) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 20:42:59 devstack cinder-volume[86962]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86962) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 20:42:59 devstack cinder-volume[86962]: INFO dbcounter [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] Registered counter for database cinder Jul 06 20:42:59 devstack cinder-volume[86962]: DEBUG oslo_db.sqlalchemy.engines [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86962) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG dbcounter [-] [86962] Writer thread running {{(pid=86962) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 20:43:00 devstack cinder-volume[86962]: INFO cinder.rpc [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 20:43:00 devstack cinder-volume[86962]: INFO cinder.rpc [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_db.sqlalchemy.engines [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86962) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 20:43:00 devstack cinder-volume[86962]: INFO cinder.volume.manager [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] Determined volume DB was empty at startup. Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG cinder.volume.manager [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86962) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 20:43:00 devstack cinder-volume[86962]: WARNING stevedore.named [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 20:43:00 devstack cinder-volume[86962]: WARNING castellan.key_manager [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 20:43:00 devstack cinder-volume[86962]: WARNING cinder.keymgr.conf_key_mgr [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 20:43:00 devstack cinder-volume[86962]: INFO cinder.volume.manager [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_db.sqlalchemy.engines [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86962) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 20:43:00 devstack cinder-volume[86962]: INFO oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] Starting 1 workers Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] Started child 87207 {{(pid=86962) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] Full set of CONF: {{(pid=86962) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] ******************************************************************************** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] Configuration options gathered from: {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] ================================================================================ {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] allow_availability_zone_fallback = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] allow_compression_on_image_upload = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] allowed_direct_url_schemes = [] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] api_rate_limit = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] auth_strategy = keystone {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_availability_zone = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_host = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_name = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_stats_polling_interval = 60 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backup_api_class = cinder.backup.api.API {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backup_name_template = backup-%s {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backup_use_same_host = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backup_use_temp_snapshot = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] chap_password = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] chap_username = {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[87207]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cinder_internal_tenant_project_id = 6bee1bdc3ef6495b8a95fd0e51559845 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cinder_internal_tenant_user_id = 8f4cdb8ed0c8479d8197d29811f42111 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cluster = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] compression_format = gzip {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] compute_api_class = cinder.compute.nova.API {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] config_dir = [] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] config_source = [] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] control_exchange = openstack {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] debug = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] default_availability_zone = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] default_group_type = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] default_volume_type = QuobyteHD {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] disk_geometry = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] driver_client_cert = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] driver_client_cert_key = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] driver_data_namespace = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] driver_ssl_cert_path = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] driver_ssl_cert_verify = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] driver_use_ssl = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] enable_new_services = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] enable_unsupported_driver = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] enabled_backends = ['QuobyteHD'] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] enforce_multipath_for_image_xfer = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] filter_function = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance_api_insecure = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance_api_servers = ['http://192.168.122.159/image'] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance_api_ssl_compression = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance_ca_certificates_file = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance_catalog_info = image:glance:publicURL {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance_certfile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance_keyfile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance_num_retries = 3 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance_request_timeout = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] goodness_function = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] graceful_shutdown_timeout = 5 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] group_api_class = cinder.group.api.API {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] host = devstack {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] image_compress_on_upload = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] image_conversion_address_space_limit = 1 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] image_conversion_cpu_limit = 60 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] image_conversion_disable = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] image_upload_use_cinder_backend = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] image_upload_use_internal_tenant = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] image_volume_cache_enabled = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] image_volume_cache_max_count = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] image_volume_cache_max_size_gb = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] init_host_max_objects_retrieval = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] instance_format = [instance: %(uuid)s] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] iscsi_target_flags = {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] iscsi_write_cache = on {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] iser_helper = tgtadm {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] iser_ip_address = 192.168.122.159 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] iser_port = 3260 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] log_color = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] log_config_append = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] log_dir = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] log_file = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] log_options = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] log_rotate_interval = 1 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] log_rotate_interval_type = days {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] log_rotation_type = none {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] max_age = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] max_logfile_count = 30 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] max_logfile_size_mb = 200 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] max_over_subscription_ratio = 20.0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] message_reap_interval = 86400 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] message_ttl = 2592000 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] migration_create_volume_timeout_secs = 300 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] monkey_patch = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] monkey_patch_modules = [] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] my_ip = 192.168.122.159 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] no_snapshot_gb_quota = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] num_iser_scan_tries = 3 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] num_shell_tries = 3 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] num_volume_device_scan_tries = 3 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] nvmeof_conn_info_version = 1 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] nvmet_ns_id = 10 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] nvmet_port_id = 1 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] osapi_max_limit = 1000 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] osapi_volume_ext_list = [] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] osapi_volume_listen = 0.0.0.0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] osapi_volume_listen_port = 8776 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] osapi_volume_use_ssl = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] osapi_volume_workers = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] per_volume_size_limit = -1 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] periodic_fuzzy_delay = 60 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] periodic_interval = 60 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] project_id_regex = [0-9a-f\-]+ {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] public_endpoint = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] publish_errors = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] quota_backup_gigabytes = 1000 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] quota_backups = 10 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] quota_gigabytes = 1000 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] quota_groups = 10 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] quota_snapshots = 10 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] quota_volumes = 10 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] rate_limit_burst = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] rate_limit_except_level = CRITICAL {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] rate_limit_interval = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] reinit_driver_count = 3 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] replication_device = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] report_discard_supported = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] report_interval = 120 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] reservation_clean_interval = 86400 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] reservation_expire = 86400 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] reserved_image_namespaces = [] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] reserved_percentage = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] rpc_response_timeout = 120 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] run_external_periodic_tasks = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] scst_target_driver = iscsi {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] scst_target_iqn_name = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] service_down_time = 720 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] shell_completion = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] snapshot_name_template = snapshot-%s {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] split_loggers = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] state_path = /opt/stack/data/cinder {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] storage_availability_zone = nova {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] storage_protocol = iSCSI {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] syslog_log_facility = LOG_USER {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] target_helper = lioadm {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] target_ip_address = 192.168.122.159 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] target_port = 3260 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] target_protocol = iscsi {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] target_secondary_ip_addresses = [] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] trace_flags = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] transfer_api_class = cinder.transfer.api.API {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] transport_url = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Starting volume driver QuobyteDriver (1.1.14) Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] until_refresh = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87207) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] use_chap_auth = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] use_default_quota_class = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] use_journal = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] use_json = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] use_multipath_for_image_xfer = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] use_stderr = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] use_syslog = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] verify_glance_signatures = enabled {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] volume_api_class = cinder.volume.api.API {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] volume_backend_name = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] volume_clear = zero {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] volume_clear_ionice = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] volume_clear_size = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] volume_copy_bps_limit = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] volume_dd_blocksize = 1M {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] volume_name_template = volume-%s {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] volume_service_inithost_offload = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] volume_usage_audit_period = month {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] zoning_mode = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_concurrency.disable_process_locking = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.auth_section = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.auth_type = password {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.auth_version = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.cache = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.certfile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.delay_auth_decision = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.http_connect_timeout = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.include_service_catalog = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.insecure = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.interface = public {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.keyfile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.memcache_password = {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.memcache_username = {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.region_name = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.service_token_roles_required = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.service_type = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.token_cache_time = 300 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.159/identity {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.backend = dogpile.cache.null {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.backend_argument = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.backend_expiration_time = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.config_prefix = cache.oslo {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.debug_cache_backend = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.enable_retry_client = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.enable_socket_keepalive = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.enabled = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.expiration_time = 600 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.hashclient_retry_attempts = 2 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.memcache_dead_retry = 300 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.memcache_pool_maxsize = 10 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.memcache_sasl_enabled = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.password = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.proxies = [] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.redis_db = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.redis_sentinel_service_name = mymaster {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.redis_server = localhost:6379 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.retry_attempts = 2 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.retry_delay = 0.0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.socket_keepalive_count = 1 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.socket_keepalive_idle = 1 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.socket_keepalive_interval = 1 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.socket_timeout = 1.0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.tls_allowed_ciphers = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.tls_cafile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.tls_certfile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.tls_enabled = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.tls_keyfile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cache.username = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] coordination.backend_url = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.asyncio_connection = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.asyncio_slave_connection = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.backend = sqlalchemy {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.connection = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.connection_debug = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.connection_parameters = {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.connection_recycle_time = 3600 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.connection_trace = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.db_inc_retry_interval = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.db_max_retries = 20 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.db_max_retry_interval = 10 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.db_retry_interval = 1 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.max_overflow = 50 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.max_pool_size = 5 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.max_retries = 10 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.mysql_wsrep_sync_wait = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.pool_timeout = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.retry_interval = 10 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.slave_connection = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.sqlite_synchronous = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.synchronous_reader = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] database.use_db_reconnect = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] profiler.connection_string = messaging:// {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] profiler.enabled = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] profiler.es_doc_type = notification {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] profiler.es_scroll_size = 10000 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] profiler.es_scroll_time = 2m {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] profiler.filter_error_trace = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] profiler.hmac_keys = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] profiler.sentinel_service_name = mymaster {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] profiler.socket_timeout = 0.1 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] profiler.trace_requests = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] profiler.trace_sqlalchemy = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] profiler_jaeger.process_tags = {} {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] profiler_jaeger.service_name_prefix = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] profiler_otlp.service_name_prefix = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_policy.enforce_new_defaults = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_policy.enforce_scope = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_policy.policy_default_rule = default {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_policy.policy_file = policy.yaml {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_policy.remote_timeout = 60.0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] privsep_osbrick.group = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] privsep_osbrick.helper_command = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] privsep_osbrick.user = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cinder_sys_admin.group = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cinder_sys_admin.helper_command = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87207) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 06 20:43:00 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.quobyte [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 06 20:43:00 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.quobyte [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 06 20:43:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Running cmd (subprocess): mount.quobyte {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] cinder_sys_admin.user = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] service_user.auth_section = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] service_user.auth_type = password {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] service_user.cafile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] service_user.certfile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] service_user.collect_timing = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] service_user.insecure = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] service_user.keyfile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] service_user.send_service_user_token = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] service_user.split_loggers = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] service_user.timeout = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance.auth_section = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance.auth_type = password {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance.certfile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance.collect_timing = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance.insecure = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance.keyfile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance.region_name = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance.split_loggers = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] glance.timeout = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.backend_availability_zone = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.chap_password = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.chap_username = {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.disk_geometry = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.driver_client_cert = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.driver_client_cert_key = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.driver_data_namespace = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.driver_use_ssl = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.enable_unsupported_driver = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.extra_capabilities = {} {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.filter_function = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.goodness_function = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.iscsi_target_flags = {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.iscsi_write_cache = on {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.iser_helper = tgtadm {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.iser_ip_address = 192.168.122.159 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.iser_port = 3260 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.nas_host = {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.nas_login = admin {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.nas_mount_options = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.nas_password = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.nas_private_key = {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.nas_share_path = {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.nas_ssh_port = 22 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.num_shell_tries = 3 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.nvmet_port_id = 1 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.quobyte_client_cfg = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.quobyte_volume_url = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.replication_device = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.report_discard_supported = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.reserved_percentage = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.scst_target_driver = iscsi {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.scst_target_iqn_name = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.storage_protocol = iSCSI {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.target_helper = tgtadm {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.target_ip_address = 192.168.122.159 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.target_port = 3260 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.target_protocol = iscsi {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.trace_flags = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.unique_fqdn_network = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.use_chap_auth = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.volume_backend_name = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.volume_clear = zero {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.volume_clear_ionice = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.volume_clear_size = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_reports.file_event_handler = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_reports.log_dir = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.backend_availability_zone = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.backend_host = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.chap_password = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.chap_username = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.chiscsi_conf = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.disk_geometry = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.driver_client_cert = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.driver_client_cert_key = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.driver_data_namespace = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.driver_use_ssl = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.extra_capabilities = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.filter_function = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.goodness_function = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.iscsi_target_flags = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.iscsi_write_cache = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.iser_helper = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.iser_ip_address = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.iser_port = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.iser_target_prefix = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack quobyte-client[87212]: Reading configuration file: /etc/quobyte/client.cfg Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.nas_host = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.nas_login = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack quobyte-client[87212]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.nas_mount_options = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.nas_password = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.nas_private_key = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.nas_share_path = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] CMD "mount.quobyte" returned: 1 in 0.054s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.nas_ssh_port = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.num_shell_tries = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.nvmet_ns_id = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.nvmet_port_id = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.replication_device = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.report_discard_supported = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.reserved_percentage = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.scst_target_driver = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.storage_protocol = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.target_helper = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.target_ip_address = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.target_port = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.target_prefix = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.target_protocol = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.trace_flags = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.unique_fqdn_network = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.use_chap_auth = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.volume_clear = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.volume_clear_ionice = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.volume_clear_size = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] QuobyteHD.volumes_dir = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.ssl = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.ssl_version = {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_notifications.driver = [] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_notifications.retry = -1 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] oslo_messaging_notifications.transport_url = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] key_manager.fixed_key = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican.barbican_api_version = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican.barbican_endpoint = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican.barbican_endpoint_type = public {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican.barbican_region_name = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican.cafile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican.certfile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican.collect_timing = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican.insecure = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican.keyfile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican.number_of_retries = 60 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican.retry_delay = 1 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican.send_service_user_token = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican.split_loggers = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican.timeout = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican.verify_ssl = True {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican.verify_ssl_path = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican_service_user.auth_section = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican_service_user.auth_type = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican_service_user.cafile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican_service_user.certfile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack sudo[87213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican_service_user.collect_timing = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican_service_user.insecure = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican_service_user.keyfile = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican_service_user.split_loggers = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] barbican_service_user.timeout = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] vault.approle_role_id = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] vault.approle_secret_id = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] vault.kv_mountpoint = secret {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] vault.kv_path = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] vault.kv_version = 2 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] vault.namespace = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] vault.root_token_id = **** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] vault.ssl_ca_crt_file = None {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] vault.timeout = 60.0 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] vault.use_ssl = False {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:43:00 devstack cinder-volume[86962]: DEBUG oslo_service.backend._eventlet.service [None req-3079c302-a69f-4c7a-8dce-582e8fa55a5a None None] ******************************************************************************** {{(pid=86962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 20:43:01 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root Jul 06 20:43:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.639s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:43:01 devstack cinder-volume[87207]: INFO cinder.volume.driver [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Driver hasn't implemented _init_vendor_properties() Jul 06 20:43:01 devstack cinder-volume[87207]: DEBUG cinder.volume.driver [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87207) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 20:43:01 devstack cinder-volume[87207]: DEBUG oslo_db.sqlalchemy.engines [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87207) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 20:43:01 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writer thread running {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 20:43:01 devstack cinder-volume[87207]: DEBUG cinder.db.api [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Building query based on filter {{(pid=87207) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 20:43:01 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87207) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 20:43:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:43:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:43:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:43:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:43:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:43:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:43:01 devstack cinder-volume[87207]: INFO cinder.keymgr.migration [None req-dafd9018-2c6f-4839-b598-f7cc4403d6f2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 20:43:01 devstack sudo[87217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:43:01 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:43:02 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root Jul 06 20:43:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.625s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:43:02 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:43:02 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Driver initialization completed successfully. Jul 06 20:43:02 devstack cinder-volume[87207]: INFO cinder.manager [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Initiating service 3 cleanup Jul 06 20:43:02 devstack cinder-volume[87207]: INFO cinder.manager [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Service 3 cleanup completed. Jul 06 20:43:02 devstack cinder-volume[87207]: DEBUG cinder.service [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Creating RPC server for service cinder-volume {{(pid=87207) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 20:43:02 devstack cinder-volume[87207]: DEBUG cinder.service [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87207) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 20:43:02 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 06 20:43:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:43:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:43:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:43:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:43:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:43:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:43:02 devstack sudo[87250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:43:02 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:43:02 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root Jul 06 20:43:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.676s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:43:02 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-38512902-5c15-4053-8017-d04e7707ddaf None None] Driver post RPC initialization completed successfully. Jul 06 20:43:10 devstack cinder-volume[86962]: DEBUG dbcounter [-] [86962] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86962) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:43:12 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:43:12 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:43:57 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:43:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Flow 'volume_create_manager' (25f0cd2e-7a2f-4b8d-a7da-9fdf44ffd162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:43:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a46b904-97fa-4080-b5b5-59c79d8bec16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:43:57 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:43:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 6 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:43:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:43:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a46b904-97fa-4080-b5b5-59c79d8bec16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1941431199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3faba1-2950-4609-9123-5baba754c257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec798ee589343d19c5d7cea0d085106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:43:58Z,use_quota=True,user_id='98a18615888c4ccc8dafde7e29ea8e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:43:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe933d8-5c0d-4cac-9743-036c0df0413f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:43:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe933d8-5c0d-4cac-9743-036c0df0413f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:43:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d236a7f6-50c8-4f31-a12f-f6fe1a848424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:43:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d236a7f6-50c8-4f31-a12f-f6fe1a848424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d3faba1-2950-4609-9123-5baba754c257', 'volume_name': 'volume-9d3faba1-2950-4609-9123-5baba754c257', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:43:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9013a9-e072-40e3-80e6-7edc17c4640b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:43:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9013a9-e072-40e3-80e6-7edc17c4640b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:43:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89933543-3095-4a55-9871-bae5cf3aadc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:43:58 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Volume 9d3faba1-2950-4609-9123-5baba754c257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d3faba1-2950-4609-9123-5baba754c257', 'volume_size': 1} Jul 06 20:43:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:43:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:43:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1941431199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3faba1-2950-4609-9123-5baba754c257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec798ee589343d19c5d7cea0d085106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:43:58Z,use_quota=True,user_id='98a18615888c4ccc8dafde7e29ea8e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:43:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Creating volume 9d3faba1-2950-4609-9123-5baba754c257 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:43:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:43:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:43:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:43:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:43:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:43:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:43:58 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:43:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9d3faba1-2950-4609-9123-5baba754c257 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:43:58 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9d3faba1-2950-4609-9123-5baba754c257 1073741824 Jul 06 20:43:58 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:43:59 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Jul 06 20:43:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9d3faba1-2950-4609-9123-5baba754c257 1073741824" returned: 0 in 1.809s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:43:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9d3faba1-2950-4609-9123-5baba754c257 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:44:00 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9d3faba1-2950-4609-9123-5baba754c257 Jul 06 20:44:00 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:44:01 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Jul 06 20:44:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9d3faba1-2950-4609-9123-5baba754c257" returned: 0 in 1.341s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:44:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] <== create_volume: return (3241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:44:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.245s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:44:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89933543-3095-4a55-9871-bae5cf3aadc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d3faba1-2950-4609-9123-5baba754c257', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:44:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b909bf66-fad2-474d-b731-329d410f4da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:44:01 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Volume volume-9d3faba1-2950-4609-9123-5baba754c257 (9d3faba1-2950-4609-9123-5baba754c257): created successfully Jul 06 20:44:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b909bf66-fad2-474d-b731-329d410f4da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:44:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Flow 'volume_create_manager' (25f0cd2e-7a2f-4b8d-a7da-9fdf44ffd162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:44:01 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9e75522e-0756-44b3-9789-fb95ffbbf6c3 tempest-TaggedAttachmentsTest-788212692 None] Created volume successfully. Jul 06 20:44:11 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:44:11 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Flow 'volume_create_manager' (a75f6927-d89a-4769-bea9-4dbf7931be57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074e8ec4-b20e-4e08-bd38-4a925f6e2fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074e8ec4-b20e-4e08-bd38-4a925f6e2fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1118026639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13a910a7-7030-4fac-a9c6-dee1e704cbef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f78e7635a8bd4048b5b7984351c90d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:44:12Z,use_quota=True,user_id='6091663c912f49d2a86fa05ecc52e8ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f317a89-d29f-47be-bb53-2d84e84669f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f317a89-d29f-47be-bb53-2d84e84669f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259b438d-3e26-458e-896b-c2b79d9c4069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259b438d-3e26-458e-896b-c2b79d9c4069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13a910a7-7030-4fac-a9c6-dee1e704cbef', 'volume_name': 'volume-13a910a7-7030-4fac-a9c6-dee1e704cbef', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17650b8-7da3-45cc-9b98-d84e4185ba7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17650b8-7da3-45cc-9b98-d84e4185ba7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424bf060-0e46-41e2-8ec9-ecd265a60498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:44:12 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Volume 13a910a7-7030-4fac-a9c6-dee1e704cbef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13a910a7-7030-4fac-a9c6-dee1e704cbef', 'volume_size': 1} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1118026639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13a910a7-7030-4fac-a9c6-dee1e704cbef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f78e7635a8bd4048b5b7984351c90d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:44:12Z,use_quota=True,user_id='6091663c912f49d2a86fa05ecc52e8ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Creating volume 13a910a7-7030-4fac-a9c6-dee1e704cbef {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:44:12 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:44:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-13a910a7-7030-4fac-a9c6-dee1e704cbef 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:44:12 devstack sudo[88096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-13a910a7-7030-4fac-a9c6-dee1e704cbef 1073741824 Jul 06 20:44:12 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:44:14 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root Jul 06 20:44:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-13a910a7-7030-4fac-a9c6-dee1e704cbef 1073741824" returned: 0 in 1.858s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:44:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-13a910a7-7030-4fac-a9c6-dee1e704cbef {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:44:14 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-13a910a7-7030-4fac-a9c6-dee1e704cbef Jul 06 20:44:14 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:44:15 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Jul 06 20:44:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-13a910a7-7030-4fac-a9c6-dee1e704cbef" returned: 0 in 1.436s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:44:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] <== create_volume: return (3380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:44:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.382s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:44:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424bf060-0e46-41e2-8ec9-ecd265a60498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13a910a7-7030-4fac-a9c6-dee1e704cbef', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:44:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bc3f4e-fcd7-484f-90e2-6753d612b757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:44:15 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Volume volume-13a910a7-7030-4fac-a9c6-dee1e704cbef (13a910a7-7030-4fac-a9c6-dee1e704cbef): created successfully Jul 06 20:44:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bc3f4e-fcd7-484f-90e2-6753d612b757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:44:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Flow 'volume_create_manager' (a75f6927-d89a-4769-bea9-4dbf7931be57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:44:16 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-256f09aa-d716-4c8f-a629-02bc8b5fe1fb tempest-DeleteServersTestJSON-1022228190 None] Created volume successfully. Jul 06 20:44:25 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:44:26 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:44:28 devstack cinder-volume[87207]: WARNING py.warnings [req-b220cc5f-46aa-4ed9-b1ab-e01e012e0180 req-473c1964-6e62-47d9-9ab2-8c0843fa24ae tempest-DeleteServersTestJSON-1022228190 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 06 20:44:28 devstack cinder-volume[87207]: .first() Jul 06 20:44:28 devstack cinder-volume[87207]: Jul 06 20:44:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-b220cc5f-46aa-4ed9-b1ab-e01e012e0180 req-473c1964-6e62-47d9-9ab2-8c0843fa24ae tempest-DeleteServersTestJSON-1022228190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:44:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-b220cc5f-46aa-4ed9-b1ab-e01e012e0180 req-473c1964-6e62-47d9-9ab2-8c0843fa24ae tempest-DeleteServersTestJSON-1022228190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:44:28 devstack cinder-volume[87207]: INFO oslo.privsep.daemon [req-b220cc5f-46aa-4ed9-b1ab-e01e012e0180 req-473c1964-6e62-47d9-9ab2-8c0843fa24ae tempest-DeleteServersTestJSON-1022228190 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_nsw_k5_/privsep.sock'] Jul 06 20:44:28 devstack sudo[88334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_nsw_k5_/privsep.sock Jul 06 20:44:28 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:44:29 devstack cinder-volume[87207]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 06 20:44:29 devstack cinder-volume[87207]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 20:44:29 devstack cinder-volume[87207]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 06 20:44:29 devstack cinder-volume[87207]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 20:44:29 devstack cinder-volume[87207]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 06 20:44:29 devstack cinder-volume[87207]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 06 20:44:29 devstack cinder-volume[87207]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 20:44:29 devstack cinder-volume[87207]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 20:44:29 devstack cinder-volume[87207]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 06 20:44:30 devstack cinder-volume[87207]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 06 20:44:30 devstack cinder-volume[87207]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 20:44:30 devstack cinder-volume[87207]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 06 20:44:30 devstack cinder-volume[87207]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 20:44:30 devstack cinder-volume[87207]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 06 20:44:30 devstack cinder-volume[87207]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 06 20:44:30 devstack cinder-volume[87207]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 20:44:30 devstack cinder-volume[87207]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 20:44:30 devstack cinder-volume[87207]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 06 20:44:30 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root Jul 06 20:44:30 devstack cinder-volume[87207]: INFO oslo.privsep.daemon [req-b220cc5f-46aa-4ed9-b1ab-e01e012e0180 req-473c1964-6e62-47d9-9ab2-8c0843fa24ae tempest-DeleteServersTestJSON-1022228190 None] Spawned new privsep daemon via rootwrap Jul 06 20:44:30 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [req-b220cc5f-46aa-4ed9-b1ab-e01e012e0180 req-473c1964-6e62-47d9-9ab2-8c0843fa24ae tempest-DeleteServersTestJSON-1022228190 None] Accepted privsep connection to /tmp/tmp_nsw_k5_/privsep.sock {{(pid=87207) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 06 20:44:30 devstack cinder-volume[87207]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 06 20:44:30 devstack cinder-volume[87207]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 06 20:44:30 devstack cinder-volume[87207]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 06 20:44:30 devstack cinder-volume[87207]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88368 Jul 06 20:44:30 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fa3951-09a2-45f6-bc26-47f06a6007bc]: (2,) {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:44:30 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ec9185-bb97-4d0a-99f7-b5d3f3cc5522]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:44:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-b220cc5f-46aa-4ed9-b1ab-e01e012e0180 req-473c1964-6e62-47d9-9ab2-8c0843fa24ae tempest-DeleteServersTestJSON-1022228190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-13a910a7-7030-4fac-a9c6-dee1e704cbef {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:44:31 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-13a910a7-7030-4fac-a9c6-dee1e704cbef Jul 06 20:44:31 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:44:32 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Jul 06 20:44:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-b220cc5f-46aa-4ed9-b1ab-e01e012e0180 req-473c1964-6e62-47d9-9ab2-8c0843fa24ae tempest-DeleteServersTestJSON-1022228190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-13a910a7-7030-4fac-a9c6-dee1e704cbef" returned: 0 in 1.657s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:44:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-b220cc5f-46aa-4ed9-b1ab-e01e012e0180 req-473c1964-6e62-47d9-9ab2-8c0843fa24ae tempest-DeleteServersTestJSON-1022228190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.169s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:44:32 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-b220cc5f-46aa-4ed9-b1ab-e01e012e0180 req-473c1964-6e62-47d9-9ab2-8c0843fa24ae tempest-DeleteServersTestJSON-1022228190 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-13a910a7-7030-4fac-a9c6-dee1e704cbef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3bb9d048-8984-4444-bbb6-3f637f97fc3e', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 20:44:32 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-b220cc5f-46aa-4ed9-b1ab-e01e012e0180 req-473c1964-6e62-47d9-9ab2-8c0843fa24ae tempest-DeleteServersTestJSON-1022228190 None] attachment_update completed successfully. Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Flow 'volume_create_manager' (5bc3474d-5da9-44fe-8e3c-f386f3d4ac25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4efc40bf-1cd1-4bc4-8e3c-b53bd11010a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4efc40bf-1cd1-4bc4-8e3c-b53bd11010a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1178337227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da444140-7124-4730-ac94-112b3a59049d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73775591da1b42069f8aea8792f601be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:44:38Z,use_quota=True,user_id='0459c0aba3904cf4a7c886560f01a7c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299fa854-3461-45dd-b059-52e8cc407aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299fa854-3461-45dd-b059-52e8cc407aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43eb5985-6000-4a52-a254-57b282cdbeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43eb5985-6000-4a52-a254-57b282cdbeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da444140-7124-4730-ac94-112b3a59049d', 'volume_name': 'volume-da444140-7124-4730-ac94-112b3a59049d', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f29547-18e2-4784-a1e2-b7e1de74555d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f29547-18e2-4784-a1e2-b7e1de74555d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe42a104-b3c0-4ef1-9a4e-1bb812970876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:44:38 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Volume da444140-7124-4730-ac94-112b3a59049d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da444140-7124-4730-ac94-112b3a59049d', 'volume_size': 1} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1178337227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da444140-7124-4730-ac94-112b3a59049d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73775591da1b42069f8aea8792f601be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:44:38Z,use_quota=True,user_id='0459c0aba3904cf4a7c886560f01a7c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Creating volume da444140-7124-4730-ac94-112b3a59049d {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:44:38 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:44:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-da444140-7124-4730-ac94-112b3a59049d 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:44:38 devstack sudo[88794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-da444140-7124-4730-ac94-112b3a59049d 1073741824 Jul 06 20:44:38 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:44:40 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root Jul 06 20:44:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-da444140-7124-4730-ac94-112b3a59049d 1073741824" returned: 0 in 1.332s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:44:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-da444140-7124-4730-ac94-112b3a59049d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:44:40 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-da444140-7124-4730-ac94-112b3a59049d Jul 06 20:44:40 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:44:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-da444140-7124-4730-ac94-112b3a59049d" returned: 0 in 0.978s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:44:41 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] <== create_volume: return (2359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:44:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.361s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:44:41 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Jul 06 20:44:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe42a104-b3c0-4ef1-9a4e-1bb812970876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da444140-7124-4730-ac94-112b3a59049d', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:44:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e3298a-708f-4735-af94-39770e81a330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:44:41 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Volume volume-da444140-7124-4730-ac94-112b3a59049d (da444140-7124-4730-ac94-112b3a59049d): created successfully Jul 06 20:44:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e3298a-708f-4735-af94-39770e81a330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:44:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Flow 'volume_create_manager' (5bc3474d-5da9-44fe-8e3c-f386f3d4ac25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:44:41 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-16905c02-ad26-4878-b895-c3966a6a1d6f tempest-ServerRescueNegativeTestJSON-2110522466 None] Created volume successfully. Jul 06 20:44:44 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-6b0f11e3-13db-4bcf-b206-9aa0fdd05d54 req-466ee1f4-f927-4cd1-933c-fcfe3d5a196a tempest-DeleteServersTestJSON-1022228190 None] Terminate volume connection completed successfully. Jul 06 20:44:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-6b0f11e3-13db-4bcf-b206-9aa0fdd05d54 req-466ee1f4-f927-4cd1-933c-fcfe3d5a196a tempest-DeleteServersTestJSON-1022228190 None] Deleting attachment 3bb9d048-8984-4444-bbb6-3f637f97fc3e. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 20:44:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Acquiring lock "cinder-13a910a7-7030-4fac-a9c6-dee1e704cbef-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:44:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Lock "cinder-13a910a7-7030-4fac-a9c6-dee1e704cbef-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:44:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Acquiring lock "cinder-quobyte-13a910a7-7030-4fac-a9c6-dee1e704cbef" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:44:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Lock "cinder-quobyte-13a910a7-7030-4fac-a9c6-dee1e704cbef" acquired by "delete_volume" :: waited 0.036s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:44:48 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec2adf3-3b8b-4dbf-bced-af32a7ff6eaa]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:44:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-13a910a7-7030-4fac-a9c6-dee1e704cbef {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:44:48 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-13a910a7-7030-4fac-a9c6-dee1e704cbef Jul 06 20:44:48 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:44:49 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Jul 06 20:44:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-13a910a7-7030-4fac-a9c6-dee1e704cbef" returned: 0 in 0.890s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:44:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-13a910a7-7030-4fac-a9c6-dee1e704cbef {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:44:49 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-13a910a7-7030-4fac-a9c6-dee1e704cbef Jul 06 20:44:49 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:44:50 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Jul 06 20:44:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-13a910a7-7030-4fac-a9c6-dee1e704cbef" returned: 0 in 0.889s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:44:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Lock "cinder-quobyte-13a910a7-7030-4fac-a9c6-dee1e704cbef" released by "delete_volume" :: held 1.828s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:44:50 devstack cinder-volume[87207]: WARNING cinder.quota [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:44:50 devstack cinder-volume[87207]: WARNING cinder.quota [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:44:50 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Created reservations ['99514bdf-40ae-4b6f-90e0-1e9d6adcac5d', 'c1a6c8a4-724d-4621-9d7f-c6eb690d9744', '0644bb4a-2eee-48d8-9541-896f63498e67', '3e13015d-067e-4074-930c-63980a8d5c51'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:44:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:44:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:44:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:44:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:44:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:44:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:44:50 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:44:50 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:44:51 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Jul 06 20:44:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.897s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:44:51 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:44:51 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Deleted volume successfully. Jul 06 20:44:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7bc01154-a733-46f9-8e1e-99d5cf38ab3f tempest-DeleteServersTestJSON-1022228190 None] Lock "cinder-13a910a7-7030-4fac-a9c6-dee1e704cbef-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:44:57 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:44:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:44:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:44:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:44:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:44:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:44:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:44:58 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:44:58 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:44:59 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Jul 06 20:44:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.703s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:44:59 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:44:59 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:44:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 8 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:44:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:45:00 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:45:01 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=14,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Flow 'volume_create_manager' (5a7b8723-5691-47f4-b0cd-eb3e16a3a22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f1470b-0f7e-4714-81c2-5bcffc5353d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f1470b-0f7e-4714-81c2-5bcffc5353d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1992657931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca9f981-159e-4d6b-8a84-36ce1100c0e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b078faf8201f4191baf22b9e3c556d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:45:07Z,use_quota=True,user_id='aac23e309cab45bc89d56edab5a455c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0282dc7-4f79-4b90-a9a3-230a6ec11a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0282dc7-4f79-4b90-a9a3-230a6ec11a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62278395-db8e-4e76-9e83-cf69098937a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62278395-db8e-4e76-9e83-cf69098937a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca9f981-159e-4d6b-8a84-36ce1100c0e1', 'volume_name': 'volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd65fe6-db71-457d-a228-2b48cb1a2019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd65fe6-db71-457d-a228-2b48cb1a2019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12474a09-258d-4ffd-a071-98e27227a7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:07 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Volume bca9f981-159e-4d6b-8a84-36ce1100c0e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1', 'volume_size': 1} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1992657931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca9f981-159e-4d6b-8a84-36ce1100c0e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b078faf8201f4191baf22b9e3c556d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:45:07Z,use_quota=True,user_id='aac23e309cab45bc89d56edab5a455c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Creating volume bca9f981-159e-4d6b-8a84-36ce1100c0e1 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:45:07 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:07 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1 1073741824 Jul 06 20:45:07 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] Acquiring lock "cinder-da444140-7124-4730-ac94-112b3a59049d-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] Lock "cinder-da444140-7124-4730-ac94-112b3a59049d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] Acquiring lock "cinder-quobyte-da444140-7124-4730-ac94-112b3a59049d" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] Lock "cinder-quobyte-da444140-7124-4730-ac94-112b3a59049d" acquired by "delete_volume" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d53c35-ed6a-4d9d-bdb2-009a38ca73cc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:45:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-da444140-7124-4730-ac94-112b3a59049d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:08 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-da444140-7124-4730-ac94-112b3a59049d Jul 06 20:45:08 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:09 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-da444140-7124-4730-ac94-112b3a59049d" returned: 0 in 1.358s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-da444140-7124-4730-ac94-112b3a59049d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:09 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1 1073741824" returned: 0 in 1.942s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:09 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-da444140-7124-4730-ac94-112b3a59049d Jul 06 20:45:09 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:09 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1 Jul 06 20:45:09 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:10 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1" returned: 0 in 0.845s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] <== create_volume: return (2892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:45:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.896s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:45:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12474a09-258d-4ffd-a071-98e27227a7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694207ba-00ac-4319-b54b-b1652792d54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:10 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Volume volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1 (bca9f981-159e-4d6b-8a84-36ce1100c0e1): created successfully Jul 06 20:45:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694207ba-00ac-4319-b54b-b1652792d54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Flow 'volume_create_manager' (5a7b8723-5691-47f4-b0cd-eb3e16a3a22d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:45:10 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-50a1b372-199e-4a7f-a071-5f755c8772c3 req-9157463e-f641-4fca-ac7e-41c47fce11f2 tempest-VolumesSnapshotsTestJSON-1045829067 None] Created volume successfully. Jul 06 20:45:10 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-da444140-7124-4730-ac94-112b3a59049d" returned: 0 in 1.356s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] Lock "cinder-quobyte-da444140-7124-4730-ac94-112b3a59049d" released by "delete_volume" :: held 2.786s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:45:10 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] Created reservations ['84e0e9b7-eabd-4017-9ea3-eee0c7da5e6d', '2260c506-3b51-4250-8e8f-970da971f955', '57d3bc08-ed65-4275-bd16-b83bfe022a2d', 'cc47c8e1-846d-4d71-8d73-c50437bad135'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:45:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:45:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:45:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:45:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:45:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:45:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:10 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:45:10 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:45:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:45:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] Creating offline snapshot b470d9f1-96d8-4edf-b27c-738757ab393b of volume bca9f981-159e-4d6b-8a84-36ce1100c0e1 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:45:11 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c699b92-d5a3-4490-a1ee-75c882285a68]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:45:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:11 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.053s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:11 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:45:11 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] Deleted volume successfully. Jul 06 20:45:11 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1 Jul 06 20:45:11 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e035ef19-511d-4171-a00c-2dcb85c8aeeb tempest-ServerRescueNegativeTestJSON-2110522466 None] Lock "cinder-da444140-7124-4730-ac94-112b3a59049d-delete_volume" released by "delete_volume" :: held 4.180s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:45:12 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1" returned: 0 in 1.297s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:13 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b 1G Jul 06 20:45:13 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:14 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b 1G" returned: 0 in 1.269s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:14 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b Jul 06 20:45:14 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:15 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b" returned: 0 in 1.511s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:15 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b is being set with open permissions: ugo+rw Jul 06 20:45:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:15 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b Jul 06 20:45:15 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:17 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b" returned: 0 in 1.348s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:17 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.info Jul 06 20:45:17 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:18 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.info" returned: 0 in 0.975s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:18 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.info is being set with open permissions: ugo+rw Jul 06 20:45:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:18 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.info Jul 06 20:45:18 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:19 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.info" returned: 0 in 0.886s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.453s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:45:19 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-55dfe1f9-8643-466f-a38f-ae997d3f8b49 req-90e684cb-acb7-4b1c-9a6e-2762b6bb0555 tempest-VolumesSnapshotsTestJSON-1045829067 None] Create snapshot completed successfully Jul 06 20:45:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] Acquiring lock "cinder-b470d9f1-96d8-4edf-b27c-738757ab393b-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:45:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] Lock "cinder-b470d9f1-96d8-4edf-b27c-738757ab393b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:45:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] Acquiring lock "cinder-quobyte-bca9f981-159e-4d6b-8a84-36ce1100c0e1" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:45:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] Lock "cinder-quobyte-bca9f981-159e-4d6b-8a84-36ce1100c0e1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:45:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] Acquiring lock "cinder-quobyte-b470d9f1-96d8-4edf-b27c-738757ab393b" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:45:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] Lock "cinder-quobyte-b470d9f1-96d8-4edf-b27c-738757ab393b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:45:20 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] Deleting offline snapshot b470d9f1-96d8-4edf-b27c-738757ab393b of volume bca9f981-159e-4d6b-8a84-36ce1100c0e1 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:45:20 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] snapshot_file for this snap is: volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:45:20 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6221d124-4a72-445a-8152-e879a0b43e01]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:45:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:20 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b Jul 06 20:45:20 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:21 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b" returned: 0 in 0.944s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:45:21 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1c2875-2902-4e4a-9922-79fd3930b8d7]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:45:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:21 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1 Jul 06 20:45:21 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:22 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1" returned: 0 in 0.970s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:22 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b Jul 06 20:45:22 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-07231ab8-0c36-4393-bd94-7804059010e5 req-be7fa80c-443e-4528-9444-dacfe446fbbb tempest-TaggedAttachmentsTest-788212692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:45:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-07231ab8-0c36-4393-bd94-7804059010e5 req-be7fa80c-443e-4528-9444-dacfe446fbbb tempest-TaggedAttachmentsTest-788212692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:45:23 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40b3d29-318d-4480-a145-1881d3f792a3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:45:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-07231ab8-0c36-4393-bd94-7804059010e5 req-be7fa80c-443e-4528-9444-dacfe446fbbb tempest-TaggedAttachmentsTest-788212692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9d3faba1-2950-4609-9123-5baba754c257 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:23 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9d3faba1-2950-4609-9123-5baba754c257 Jul 06 20:45:23 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:23 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b" returned: 0 in 1.134s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:23 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b Jul 06 20:45:23 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:24 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-07231ab8-0c36-4393-bd94-7804059010e5 req-be7fa80c-443e-4528-9444-dacfe446fbbb tempest-TaggedAttachmentsTest-788212692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9d3faba1-2950-4609-9123-5baba754c257" returned: 0 in 1.099s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-07231ab8-0c36-4393-bd94-7804059010e5 req-be7fa80c-443e-4528-9444-dacfe446fbbb tempest-TaggedAttachmentsTest-788212692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.133s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:45:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-07231ab8-0c36-4393-bd94-7804059010e5 req-be7fa80c-443e-4528-9444-dacfe446fbbb tempest-TaggedAttachmentsTest-788212692 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-9d3faba1-2950-4609-9123-5baba754c257', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '534fc1d2-b871-4bd6-90d0-29b8ea21ce9f', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 20:45:24 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-07231ab8-0c36-4393-bd94-7804059010e5 req-be7fa80c-443e-4528-9444-dacfe446fbbb tempest-TaggedAttachmentsTest-788212692 None] attachment_update completed successfully. Jul 06 20:45:24 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1.b470d9f1-96d8-4edf-b27c-738757ab393b" returned: 0 in 0.797s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] Lock "cinder-quobyte-b470d9f1-96d8-4edf-b27c-738757ab393b" released by "_delete_snapshot" :: held 3.974s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:45:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] Lock "cinder-quobyte-bca9f981-159e-4d6b-8a84-36ce1100c0e1" released by "delete_snapshot" :: held 4.004s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:45:24 devstack cinder-volume[87207]: WARNING cinder.quota [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:45:24 devstack cinder-volume[87207]: DEBUG cinder.quota [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] Created reservations ['2df8adad-9ea0-45b3-9e17-5fb81a18a81b', 'c6ecef1b-671a-4dfe-b889-d80fcefd3919', '7e5d7b31-3571-4019-9abd-e285173f38cc', 'c88d60f1-c40c-4e47-a491-674e37f76014'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:45:24 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] Delete snapshot completed successfully. Jul 06 20:45:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-22ac1825-5cb3-448c-9cf8-378b5d1f13bb req-67999c6c-cdec-4871-b826-0e0f3e76f357 tempest-VolumesSnapshotsTestJSON-1045829067 None] Lock "cinder-b470d9f1-96d8-4edf-b27c-738757ab393b-delete_snapshot" released by "delete_snapshot" :: held 4.185s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:45:25 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] Acquiring lock "cinder-bca9f981-159e-4d6b-8a84-36ce1100c0e1-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:45:25 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] Lock "cinder-bca9f981-159e-4d6b-8a84-36ce1100c0e1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:45:25 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] Acquiring lock "cinder-quobyte-bca9f981-159e-4d6b-8a84-36ce1100c0e1" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:45:25 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] Lock "cinder-quobyte-bca9f981-159e-4d6b-8a84-36ce1100c0e1" acquired by "delete_volume" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:45:25 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[79148662-c78b-4ecc-ae37-23471a7aa213]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:45:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:25 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1 Jul 06 20:45:25 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:25 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1" returned: 0 in 0.779s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:25 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1 Jul 06 20:45:25 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:26 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bca9f981-159e-4d6b-8a84-36ce1100c0e1" returned: 0 in 0.658s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:26 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] Lock "cinder-quobyte-bca9f981-159e-4d6b-8a84-36ce1100c0e1" released by "delete_volume" :: held 1.498s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:45:26 devstack cinder-volume[87207]: DEBUG cinder.quota [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] Created reservations ['a5ab2709-9d14-4018-bb7f-8710f5e5568c', '7ec87883-f3ed-481f-a478-c5162acdf75b', '9a71bbaf-567c-48ed-aed0-9a1ec59909b7', '7e0c308d-0412-49c1-9356-ef02eb3166f2'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:45:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:45:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:45:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:45:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:45:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:45:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:26 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:45:26 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:27 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.688s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:27 devstack cinder-volume[87207]: DEBUG cinder.manager [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:45:27 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] Deleted volume successfully. Jul 06 20:45:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-23d7c274-1bd2-4478-b1ea-5cf2237c696e req-552cdabb-c07e-4857-bdf3-a1b2f0e4b580 tempest-VolumesSnapshotsTestJSON-1045829067 None] Lock "cinder-bca9f981-159e-4d6b-8a84-36ce1100c0e1-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:45:31 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-bd94f8a3-bef2-4776-9a59-8744568659c2 req-9d4c034a-f454-456e-9df9-d65b3140c979 tempest-TaggedAttachmentsTest-788212692 None] Terminate volume connection completed successfully. Jul 06 20:45:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-bd94f8a3-bef2-4776-9a59-8744568659c2 req-9d4c034a-f454-456e-9df9-d65b3140c979 tempest-TaggedAttachmentsTest-788212692 None] Deleting attachment 534fc1d2-b871-4bd6-90d0-29b8ea21ce9f. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 20:45:37 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=26,cinder:UPDATE=33,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Flow 'volume_create_manager' (961e32f3-e13a-4091-8d09-613f65164e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e02ad8bb-b16a-406c-9991-cecd7f9a7195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e02ad8bb-b16a-406c-9991-cecd7f9a7195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2028635661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af272282-8f8b-4b72-bf3d-b7721af5a3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='facb9dd1402745e29d8a7e91a223d9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:45:40Z,use_quota=True,user_id='b4d9d15311fc445da31e9985ebcb58df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ab94a9-1007-4f1d-a3a9-3d5b700374f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ab94a9-1007-4f1d-a3a9-3d5b700374f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97fbc87a-763c-43cd-82be-30b05d467343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97fbc87a-763c-43cd-82be-30b05d467343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af272282-8f8b-4b72-bf3d-b7721af5a3c1', 'volume_name': 'volume-af272282-8f8b-4b72-bf3d-b7721af5a3c1', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992d01fe-ffad-4f4a-beff-8067c580ab5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992d01fe-ffad-4f4a-beff-8067c580ab5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5eb5200-f0bf-4279-bdc6-71d74011829a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:39 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Volume af272282-8f8b-4b72-bf3d-b7721af5a3c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af272282-8f8b-4b72-bf3d-b7721af5a3c1', 'volume_size': 1} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2028635661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af272282-8f8b-4b72-bf3d-b7721af5a3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='facb9dd1402745e29d8a7e91a223d9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:45:40Z,use_quota=True,user_id='b4d9d15311fc445da31e9985ebcb58df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Creating volume af272282-8f8b-4b72-bf3d-b7721af5a3c1 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:45:39 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:45:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-af272282-8f8b-4b72-bf3d-b7721af5a3c1 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:39 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-af272282-8f8b-4b72-bf3d-b7721af5a3c1 1073741824 Jul 06 20:45:39 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:41 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-af272282-8f8b-4b72-bf3d-b7721af5a3c1 1073741824" returned: 0 in 1.256s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-af272282-8f8b-4b72-bf3d-b7721af5a3c1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:41 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-af272282-8f8b-4b72-bf3d-b7721af5a3c1 Jul 06 20:45:41 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:42 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-af272282-8f8b-4b72-bf3d-b7721af5a3c1" returned: 0 in 0.865s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] <== create_volume: return (2202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:45:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.210s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:45:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5eb5200-f0bf-4279-bdc6-71d74011829a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af272282-8f8b-4b72-bf3d-b7721af5a3c1', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be5271c-4db5-4b16-87a6-9d84a1661b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:42 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Volume volume-af272282-8f8b-4b72-bf3d-b7721af5a3c1 (af272282-8f8b-4b72-bf3d-b7721af5a3c1): created successfully Jul 06 20:45:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be5271c-4db5-4b16-87a6-9d84a1661b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Flow 'volume_create_manager' (961e32f3-e13a-4091-8d09-613f65164e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:45:42 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-c89202e1-6431-4274-aeeb-46ec0ef659ae tempest-VolumesAdminNegativeTest-1197409100 None] Created volume successfully. Jul 06 20:45:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] Acquiring lock "cinder-af272282-8f8b-4b72-bf3d-b7721af5a3c1-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:45:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] Lock "cinder-af272282-8f8b-4b72-bf3d-b7721af5a3c1-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:45:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] Acquiring lock "cinder-quobyte-af272282-8f8b-4b72-bf3d-b7721af5a3c1" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:45:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] Lock "cinder-quobyte-af272282-8f8b-4b72-bf3d-b7721af5a3c1" acquired by "delete_volume" :: waited 0.030s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:45:44 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a3f61d-697e-4785-b41f-14a7de7f4c89]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:45:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-af272282-8f8b-4b72-bf3d-b7721af5a3c1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:44 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-af272282-8f8b-4b72-bf3d-b7721af5a3c1 Jul 06 20:45:44 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:45 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-af272282-8f8b-4b72-bf3d-b7721af5a3c1" returned: 0 in 1.632s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-af272282-8f8b-4b72-bf3d-b7721af5a3c1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:45 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-af272282-8f8b-4b72-bf3d-b7721af5a3c1 Jul 06 20:45:45 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:45 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:45:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Flow 'volume_create_manager' (e8a220a5-1fb5-4081-ab56-52558b6aa48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbb20ce-032e-4abe-8cda-7d05a88254c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbb20ce-032e-4abe-8cda-7d05a88254c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2079966389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7356ce-93b3-48a0-a1f5-fb423fe864a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be350e906e3c4848851a55199e36c757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:45:46Z,use_quota=True,user_id='189ea084d8cf40979869eee0af54718f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a699efc-de55-4bd5-928d-0c2fb046f1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a699efc-de55-4bd5-928d-0c2fb046f1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d81639c-6204-41f4-b3fe-f91a141f6c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d81639c-6204-41f4-b3fe-f91a141f6c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff7356ce-93b3-48a0-a1f5-fb423fe864a8', 'volume_name': 'volume-ff7356ce-93b3-48a0-a1f5-fb423fe864a8', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cacb60-34e0-4f19-a8a6-3e80b32f1660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cacb60-34e0-4f19-a8a6-3e80b32f1660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b82d86-2cae-4ad4-acfe-0f2f905aadd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:46 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Volume ff7356ce-93b3-48a0-a1f5-fb423fe864a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff7356ce-93b3-48a0-a1f5-fb423fe864a8', 'volume_size': 1} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2079966389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7356ce-93b3-48a0-a1f5-fb423fe864a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be350e906e3c4848851a55199e36c757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:45:46Z,use_quota=True,user_id='189ea084d8cf40979869eee0af54718f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Creating volume ff7356ce-93b3-48a0-a1f5-fb423fe864a8 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:45:46 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:45:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff7356ce-93b3-48a0-a1f5-fb423fe864a8 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:46 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff7356ce-93b3-48a0-a1f5-fb423fe864a8 1073741824 Jul 06 20:45:46 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:47 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-af272282-8f8b-4b72-bf3d-b7721af5a3c1" returned: 0 in 1.193s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:47 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] Lock "cinder-quobyte-af272282-8f8b-4b72-bf3d-b7721af5a3c1" released by "delete_volume" :: held 2.926s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:45:47 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] Created reservations ['b2e4b5c4-441d-411c-b2e2-c81f6c9cb4fb', '5ee018b5-1317-4a88-bce4-8d1a077e5d1c', 'f120e9e1-ad72-486d-ab29-cb79791b3de7', '1a9ca393-611c-4d5a-b958-d3a0e8e187d9'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:45:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:45:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:45:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:45:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:45:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:45:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:47 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:45:47 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:47 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff7356ce-93b3-48a0-a1f5-fb423fe864a8 1073741824" returned: 0 in 1.533s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff7356ce-93b3-48a0-a1f5-fb423fe864a8 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:47 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff7356ce-93b3-48a0-a1f5-fb423fe864a8 Jul 06 20:45:47 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:48 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.076s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:48 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:45:48 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] Deleted volume successfully. Jul 06 20:45:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a02c5731-245b-4877-a098-800fc765551b tempest-VolumesAdminNegativeTest-1197409100 None] Lock "cinder-af272282-8f8b-4b72-bf3d-b7721af5a3c1-delete_volume" released by "delete_volume" :: held 4.363s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:45:48 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff7356ce-93b3-48a0-a1f5-fb423fe864a8" returned: 0 in 1.170s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] <== create_volume: return (2787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:45:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.794s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:45:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b82d86-2cae-4ad4-acfe-0f2f905aadd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff7356ce-93b3-48a0-a1f5-fb423fe864a8', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18b2a0e-0fbd-41c7-826d-44f174f7b0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:48 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Volume volume-ff7356ce-93b3-48a0-a1f5-fb423fe864a8 (ff7356ce-93b3-48a0-a1f5-fb423fe864a8): created successfully Jul 06 20:45:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18b2a0e-0fbd-41c7-826d-44f174f7b0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Flow 'volume_create_manager' (e8a220a5-1fb5-4081-ab56-52558b6aa48d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:45:48 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-1c3ed2b8-7b6c-4148-a9fa-b577bd96f2fb tempest-VolumeQuotasAdminTestJSON-993327481 None] Created volume successfully. Jul 06 20:45:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] Acquiring lock "cinder-ff7356ce-93b3-48a0-a1f5-fb423fe864a8-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:45:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] Lock "cinder-ff7356ce-93b3-48a0-a1f5-fb423fe864a8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:45:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] Acquiring lock "cinder-quobyte-ff7356ce-93b3-48a0-a1f5-fb423fe864a8" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:45:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] Lock "cinder-quobyte-ff7356ce-93b3-48a0-a1f5-fb423fe864a8" acquired by "delete_volume" :: waited 0.033s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:45:49 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8a8852-d464-4b1a-bd80-4f2e427f9634]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:45:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff7356ce-93b3-48a0-a1f5-fb423fe864a8 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:49 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff7356ce-93b3-48a0-a1f5-fb423fe864a8 Jul 06 20:45:49 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:50 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff7356ce-93b3-48a0-a1f5-fb423fe864a8" returned: 0 in 1.132s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff7356ce-93b3-48a0-a1f5-fb423fe864a8 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:50 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff7356ce-93b3-48a0-a1f5-fb423fe864a8 Jul 06 20:45:50 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:51 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff7356ce-93b3-48a0-a1f5-fb423fe864a8" returned: 0 in 0.700s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] Lock "cinder-quobyte-ff7356ce-93b3-48a0-a1f5-fb423fe864a8" released by "delete_volume" :: held 1.906s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:45:51 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] Created reservations ['dbf8f1b2-9e96-4d95-a61e-a68c78895664', '782c0be0-3d9a-49d3-8df3-ecc89c5d35d8', '96adbf19-9d1b-4c74-8db2-c68520170e86', '30445fdb-abff-42e7-8823-b7f7d3387f08'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:45:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:45:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:45:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:45:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:45:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:45:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:51 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:45:51 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:45:52 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Flow 'volume_create_manager' (0fb9d668-f8f6-429a-9834-f5ea7c389db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (187b39a3-1273-4b02-9bfb-3b0374d8cc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.965s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:45:52 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] Deleted volume successfully. Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (187b39a3-1273-4b02-9bfb-3b0374d8cc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1346052251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887b9f03-0fa1-4f68-800f-3b05d7bfd8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be350e906e3c4848851a55199e36c757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:45:52Z,use_quota=True,user_id='189ea084d8cf40979869eee0af54718f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5de820-a806-41af-ad13-ce6f0b932933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5de820-a806-41af-ad13-ce6f0b932933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d7d371-95ed-4990-b761-cfe47c93dffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d7d371-95ed-4990-b761-cfe47c93dffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '887b9f03-0fa1-4f68-800f-3b05d7bfd8c9', 'volume_name': 'volume-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (743fbc19-7e7c-493b-9d49-873e1e57ec34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (743fbc19-7e7c-493b-9d49-873e1e57ec34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d00ec73-ef5a-4107-b7d7-5e54aec6f56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:52 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Volume 887b9f03-0fa1-4f68-800f-3b05d7bfd8c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9', 'volume_size': 1} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1346052251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887b9f03-0fa1-4f68-800f-3b05d7bfd8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be350e906e3c4848851a55199e36c757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:45:52Z,use_quota=True,user_id='189ea084d8cf40979869eee0af54718f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Creating volume 887b9f03-0fa1-4f68-800f-3b05d7bfd8c9 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:45:52 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:52 devstack sudo[89923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9 1073741824 Jul 06 20:45:52 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-981c4480-37ed-4b0b-82a4-04401a01a678 tempest-VolumeQuotasAdminTestJSON-993327481 None] Lock "cinder-ff7356ce-93b3-48a0-a1f5-fb423fe864a8-delete_volume" released by "delete_volume" :: held 3.337s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:45:53 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9 1073741824" returned: 0 in 1.295s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:54 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9 Jul 06 20:45:54 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] Acquiring lock "cinder-9d3faba1-2950-4609-9123-5baba754c257-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:45:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] Lock "cinder-9d3faba1-2950-4609-9123-5baba754c257-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:45:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] Acquiring lock "cinder-quobyte-9d3faba1-2950-4609-9123-5baba754c257" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:45:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] Lock "cinder-quobyte-9d3faba1-2950-4609-9123-5baba754c257" acquired by "delete_volume" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:45:54 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84aa8c0-ee15-4873-b2da-0f5a354b92bf]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:45:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9d3faba1-2950-4609-9123-5baba754c257 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:54 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9d3faba1-2950-4609-9123-5baba754c257 Jul 06 20:45:54 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:54 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9" returned: 0 in 0.692s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:45:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:45:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d00ec73-ef5a-4107-b7d7-5e54aec6f56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd1ade8c-799a-4b9a-8111-90a4dd7ded7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:45:54 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Volume volume-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9 (887b9f03-0fa1-4f68-800f-3b05d7bfd8c9): created successfully Jul 06 20:45:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd1ade8c-799a-4b9a-8111-90a4dd7ded7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:45:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Flow 'volume_create_manager' (0fb9d668-f8f6-429a-9834-f5ea7c389db4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:45:54 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e032925a-6d88-4de7-8929-cfdf113aa295 tempest-VolumeQuotasAdminTestJSON-993327481 None] Created volume successfully. Jul 06 20:45:55 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9d3faba1-2950-4609-9123-5baba754c257" returned: 0 in 0.825s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9d3faba1-2950-4609-9123-5baba754c257 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:55 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9d3faba1-2950-4609-9123-5baba754c257 Jul 06 20:45:55 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:56 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9d3faba1-2950-4609-9123-5baba754c257" returned: 0 in 0.789s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] Lock "cinder-quobyte-9d3faba1-2950-4609-9123-5baba754c257" released by "delete_volume" :: held 1.687s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:45:56 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] Created reservations ['fcaaf748-bd7c-47ba-aa8b-06a5a69d0595', '5453ee2a-e6e4-4a9d-9437-a90361a0daf9', 'b56f94c8-0391-4c07-b3c6-844eb1bf203c', 'eab2875f-bab6-45c1-99f0-52e62add8b65'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:45:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:45:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:45:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:45:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:45:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:45:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:56 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:45:56 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:56 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-5c84f408-55b4-4ca0-afe5-0b5626cda83c tempest-VolumeQuotasAdminTestJSON-1318815653 None] Transfer volume completed successfully. Jul 06 20:45:57 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.718s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:57 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:45:57 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] Deleted volume successfully. Jul 06 20:45:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f14036b4-1243-44c2-a64e-f0a14fa2d1ae tempest-TaggedAttachmentsTest-788212692 None] Lock "cinder-9d3faba1-2950-4609-9123-5baba754c257-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:45:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] Acquiring lock "cinder-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:45:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] Lock "cinder-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:45:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] Acquiring lock "cinder-quobyte-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:45:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] Lock "cinder-quobyte-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9" acquired by "delete_volume" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:45:57 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e055b027-e095-410b-ad7d-89c3771b6c74]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:45:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:57 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9 Jul 06 20:45:57 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:57 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:45:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:45:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:45:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:45:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:45:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:45:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:58 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:45:58 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:58 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9" returned: 0 in 0.902s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:58 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9 Jul 06 20:45:58 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:45:58 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.875s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:45:59 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Jul 06 20:45:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9" returned: 0 in 0.761s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:45:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] Lock "cinder-quobyte-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9" released by "delete_volume" :: held 1.721s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:45:59 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] Created reservations ['1bca7eca-9440-4ad7-8970-c2bacfb41590', 'b23ced50-e6a9-48bb-b595-dec75faa1657', '21dd432c-f485-4063-b5a2-6cc45df7a328', '7e506bb3-6cc6-4a7e-9d0d-7cc19fdc819f'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:45:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:45:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:45:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:45:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:45:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:45:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:45:59 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:45:59 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:00 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.767s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:00 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:46:00 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] Deleted volume successfully. Jul 06 20:46:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0f627eb9-53f4-4151-98fe-865e8db5989e tempest-VolumeQuotasAdminTestJSON-1240300155 None] Lock "cinder-887b9f03-0fa1-4f68-800f-3b05d7bfd8c9-delete_volume" released by "delete_volume" :: held 2.824s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:46:09 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=57,cinder:UPDATE=67,cinder:INSERT=16,cinder:DELETE=3 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:46:10 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=26,cinder:UPDATE=38,cinder:DELETE=5,cinder:INSERT=9 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:46:11 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:46:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Flow 'volume_create_manager' (ed30574b-f2e3-4ea8-8c62-cd483b26605f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:46:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8811d595-8293-4024-ace0-67074d9110b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:46:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8811d595-8293-4024-ace0-67074d9110b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1502849059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621ac8fc-dbd0-4f48-9135-9627f2096699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2897802f42c64a08bf1d79ab0983a5f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:46:12Z,use_quota=True,user_id='6395786ee3074e028bab01dc34cb7904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:46:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb58073-77cb-49d9-84d7-ea9bc87ea6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:46:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb58073-77cb-49d9-84d7-ea9bc87ea6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:46:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce886f8-27c3-49b7-9c12-b14a5f96be87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:46:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce886f8-27c3-49b7-9c12-b14a5f96be87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '621ac8fc-dbd0-4f48-9135-9627f2096699', 'volume_name': 'volume-621ac8fc-dbd0-4f48-9135-9627f2096699', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:46:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea97be12-431c-420c-b5c7-88f6993fa393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:46:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea97be12-431c-420c-b5c7-88f6993fa393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:46:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f890b4f-d115-4d13-b036-064f8477d878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:46:12 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Volume 621ac8fc-dbd0-4f48-9135-9627f2096699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-621ac8fc-dbd0-4f48-9135-9627f2096699', 'volume_size': 1} Jul 06 20:46:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:46:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:46:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1502849059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621ac8fc-dbd0-4f48-9135-9627f2096699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2897802f42c64a08bf1d79ab0983a5f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:46:12Z,use_quota=True,user_id='6395786ee3074e028bab01dc34cb7904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:46:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Creating volume 621ac8fc-dbd0-4f48-9135-9627f2096699 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:46:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:46:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:46:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:46:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:46:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:46:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:46:12 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:46:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-621ac8fc-dbd0-4f48-9135-9627f2096699 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:12 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-621ac8fc-dbd0-4f48-9135-9627f2096699 1073741824 Jul 06 20:46:12 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:13 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-621ac8fc-dbd0-4f48-9135-9627f2096699 1073741824" returned: 0 in 1.161s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-621ac8fc-dbd0-4f48-9135-9627f2096699 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:13 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-621ac8fc-dbd0-4f48-9135-9627f2096699 Jul 06 20:46:13 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:13 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-621ac8fc-dbd0-4f48-9135-9627f2096699" returned: 0 in 0.754s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:46:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:46:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f890b4f-d115-4d13-b036-064f8477d878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-621ac8fc-dbd0-4f48-9135-9627f2096699', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:46:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3e1884-9598-4181-8332-23da6fb47824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:46:14 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Volume volume-621ac8fc-dbd0-4f48-9135-9627f2096699 (621ac8fc-dbd0-4f48-9135-9627f2096699): created successfully Jul 06 20:46:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3e1884-9598-4181-8332-23da6fb47824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:46:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Flow 'volume_create_manager' (ed30574b-f2e3-4ea8-8c62-cd483b26605f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:46:14 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e43249f6-86a6-41ca-84cf-dc27524dfac7 tempest-VolumesServicesTestJSON-987763207 None] Created volume successfully. Jul 06 20:46:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] Acquiring lock "cinder-621ac8fc-dbd0-4f48-9135-9627f2096699-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:46:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] Lock "cinder-621ac8fc-dbd0-4f48-9135-9627f2096699-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:46:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] Acquiring lock "cinder-quobyte-621ac8fc-dbd0-4f48-9135-9627f2096699" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:46:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] Lock "cinder-quobyte-621ac8fc-dbd0-4f48-9135-9627f2096699" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:46:15 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1421a2-f041-4f98-962b-77c74a2b805d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:46:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-621ac8fc-dbd0-4f48-9135-9627f2096699 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:15 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-621ac8fc-dbd0-4f48-9135-9627f2096699 Jul 06 20:46:15 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:16 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-621ac8fc-dbd0-4f48-9135-9627f2096699" returned: 0 in 1.163s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-621ac8fc-dbd0-4f48-9135-9627f2096699 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:16 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-621ac8fc-dbd0-4f48-9135-9627f2096699 Jul 06 20:46:16 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:17 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-621ac8fc-dbd0-4f48-9135-9627f2096699" returned: 0 in 0.724s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] Lock "cinder-quobyte-621ac8fc-dbd0-4f48-9135-9627f2096699" released by "delete_volume" :: held 1.940s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:46:17 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] Created reservations ['693d8d6c-0b6f-4971-8405-93551062234d', '931fe95f-028d-4513-8853-6bd1f66298ea', '1e8d4554-139b-44c4-a8f0-62cc47f865ad', '578277e0-c100-4b4b-94a7-fdf10adf633f'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:46:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:46:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:46:17 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:46:17 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:46:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:46:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:17 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:46:17 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:18 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.043s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:18 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:46:18 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] Deleted volume successfully. Jul 06 20:46:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d9e54d74-81f7-4bb2-ad47-4cba35549c3c tempest-VolumesServicesTestJSON-987763207 None] Lock "cinder-621ac8fc-dbd0-4f48-9135-9627f2096699-delete_volume" released by "delete_volume" :: held 3.305s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:46:27 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:UPDATE=13,cinder:SELECT=5,cinder:DELETE=1,cinder:INSERT=3 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:46:28 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=9,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Flow 'volume_create_manager' (45869cf1-0773-42a9-807e-52eb08e788f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506de4fd-af63-4d88-bd94-6f03b7260b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506de4fd-af63-4d88-bd94-6f03b7260b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-856943716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caea6718-b02a-445a-ae9d-109c47bded06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f2de1a04d143499e6840162cfec3d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:46:38Z,use_quota=True,user_id='3bbdeeda2b0945488ed02cd64512ccc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056c5681-8ffc-48d4-a589-84bc8a91b842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056c5681-8ffc-48d4-a589-84bc8a91b842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9bf9c8-762f-40fb-924a-f908d5665b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9bf9c8-762f-40fb-924a-f908d5665b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caea6718-b02a-445a-ae9d-109c47bded06', 'volume_name': 'volume-caea6718-b02a-445a-ae9d-109c47bded06', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c3b503e-0300-47df-974b-b581a6aed294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c3b503e-0300-47df-974b-b581a6aed294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f11e324-4709-4cac-85d8-bfa3c590c3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:46:38 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Volume caea6718-b02a-445a-ae9d-109c47bded06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caea6718-b02a-445a-ae9d-109c47bded06', 'volume_size': 1} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-856943716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caea6718-b02a-445a-ae9d-109c47bded06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f2de1a04d143499e6840162cfec3d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:46:38Z,use_quota=True,user_id='3bbdeeda2b0945488ed02cd64512ccc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Creating volume caea6718-b02a-445a-ae9d-109c47bded06 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:46:38 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:46:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:38 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06 1073741824 Jul 06 20:46:38 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:39 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06 1073741824" returned: 0 in 0.855s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:39 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06 Jul 06 20:46:39 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:39 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06" returned: 0 in 0.817s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:46:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:46:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f11e324-4709-4cac-85d8-bfa3c590c3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caea6718-b02a-445a-ae9d-109c47bded06', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:46:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e75307-50d0-448c-910b-69b62ade0d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:46:39 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Volume volume-caea6718-b02a-445a-ae9d-109c47bded06 (caea6718-b02a-445a-ae9d-109c47bded06): created successfully Jul 06 20:46:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e75307-50d0-448c-910b-69b62ade0d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:46:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Flow 'volume_create_manager' (45869cf1-0773-42a9-807e-52eb08e788f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:46:39 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-cff9887e-38cd-4a3a-b50b-6b061e8e2cb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Created volume successfully. Jul 06 20:46:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:46:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:46:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Creating offline snapshot 3bfbced2-4c77-4106-a4c9-fab101ad2861 of volume caea6718-b02a-445a-ae9d-109c47bded06 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:46:40 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[13039b01-c723-47fd-b166-0fad532ac4c8]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:46:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:40 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06 Jul 06 20:46:40 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:41 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06" returned: 0 in 0.985s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:41 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861 1G Jul 06 20:46:41 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:42 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861 1G" returned: 0 in 1.263s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caea6718-b02a-445a-ae9d-109c47bded06 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:42 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caea6718-b02a-445a-ae9d-109c47bded06 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861 Jul 06 20:46:42 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:42 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:46:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Flow 'volume_create_manager' (7ee83c84-792a-4862-8da2-1c4cd916c157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:46:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a54717-52c9-4703-91fc-ee42a4b96dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:46:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a54717-52c9-4703-91fc-ee42a4b96dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2077277271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bccb1c52-c75a-4229-9a13-e5f06690a986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d82168fefb5e4507a4e32be31fe8acc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:46:43Z,use_quota=True,user_id='a5bbd9c35a2d4fedb0f403e079dc4992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:46:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6307fb79-124d-459f-999c-32833c5cba17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:46:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6307fb79-124d-459f-999c-32833c5cba17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:46:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0b6d44-9c90-4b0b-8102-ce89ef00683a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:46:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0b6d44-9c90-4b0b-8102-ce89ef00683a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bccb1c52-c75a-4229-9a13-e5f06690a986', 'volume_name': 'volume-bccb1c52-c75a-4229-9a13-e5f06690a986', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:46:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b7a0fbb-6f6a-46b7-b21a-30853c4a1f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:46:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b7a0fbb-6f6a-46b7-b21a-30853c4a1f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:46:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0721cbe-e405-4de3-91f9-2a9a825c8529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:46:42 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Volume bccb1c52-c75a-4229-9a13-e5f06690a986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bccb1c52-c75a-4229-9a13-e5f06690a986', 'volume_size': 1} Jul 06 20:46:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:46:43 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caea6718-b02a-445a-ae9d-109c47bded06 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861" returned: 0 in 0.798s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:43 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861 is being set with open permissions: ugo+rw Jul 06 20:46:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:43 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861 Jul 06 20:46:43 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:44 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861" returned: 0 in 0.778s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:44 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.info Jul 06 20:46:44 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:45 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.info" returned: 0 in 0.709s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:45 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.info is being set with open permissions: ugo+rw Jul 06 20:46:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:45 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.info Jul 06 20:46:45 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:45 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.info" returned: 0 in 0.640s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.268s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:46:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.818s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:46:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2077277271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bccb1c52-c75a-4229-9a13-e5f06690a986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d82168fefb5e4507a4e32be31fe8acc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:46:43Z,use_quota=True,user_id='a5bbd9c35a2d4fedb0f403e079dc4992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:46:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Creating volume bccb1c52-c75a-4229-9a13-e5f06690a986 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:46:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:46:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:46:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:46:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:46:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:46:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:46:45 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:46:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bccb1c52-c75a-4229-9a13-e5f06690a986 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:45 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bccb1c52-c75a-4229-9a13-e5f06690a986 1073741824 Jul 06 20:46:45 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:45 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-546cb720-5bec-4c88-999f-0dc73caac867 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Create snapshot completed successfully Jul 06 20:46:47 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bccb1c52-c75a-4229-9a13-e5f06690a986 1073741824" returned: 0 in 1.263s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bccb1c52-c75a-4229-9a13-e5f06690a986 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:47 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bccb1c52-c75a-4229-9a13-e5f06690a986 Jul 06 20:46:47 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Acquiring lock "cinder-3bfbced2-4c77-4106-a4c9-fab101ad2861-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:46:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Lock "cinder-3bfbced2-4c77-4106-a4c9-fab101ad2861-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:46:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Acquiring lock "cinder-quobyte-caea6718-b02a-445a-ae9d-109c47bded06" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:46:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Lock "cinder-quobyte-caea6718-b02a-445a-ae9d-109c47bded06" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:46:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Acquiring lock "cinder-quobyte-3bfbced2-4c77-4106-a4c9-fab101ad2861" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:46:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Lock "cinder-quobyte-3bfbced2-4c77-4106-a4c9-fab101ad2861" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:46:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Deleting offline snapshot 3bfbced2-4c77-4106-a4c9-fab101ad2861 of volume caea6718-b02a-445a-ae9d-109c47bded06 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:46:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] snapshot_file for this snap is: volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:46:48 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae58e0a-1c08-4170-8c2f-08d78cef0f18]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:46:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:48 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bccb1c52-c75a-4229-9a13-e5f06690a986" returned: 0 in 1.156s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] <== create_volume: return (2490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:46:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.493s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:46:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0721cbe-e405-4de3-91f9-2a9a825c8529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bccb1c52-c75a-4229-9a13-e5f06690a986', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:46:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b538ede3-01f6-43d0-8d28-75ff07281c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:46:48 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Volume volume-bccb1c52-c75a-4229-9a13-e5f06690a986 (bccb1c52-c75a-4229-9a13-e5f06690a986): created successfully Jul 06 20:46:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b538ede3-01f6-43d0-8d28-75ff07281c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:46:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Flow 'volume_create_manager' (7ee83c84-792a-4862-8da2-1c4cd916c157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:46:48 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-3ff378de-0449-4fe9-90c2-e8ea90e37736 tempest-AttachVolumeShelveTestJSON-222273946 None] Created volume successfully. Jul 06 20:46:48 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861 Jul 06 20:46:48 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:49 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861" returned: 0 in 1.005s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-caea6718-b02a-445a-ae9d-109c47bded06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:46:49 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[847abcad-9c8b-4ff9-a9d3-1d9fd5e208b9]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:46:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:49 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06 Jul 06 20:46:49 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:50 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06" returned: 0 in 1.236s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:50 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861 Jul 06 20:46:50 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:51 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861" returned: 0 in 1.450s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:51 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861 Jul 06 20:46:51 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:53 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06.3bfbced2-4c77-4106-a4c9-fab101ad2861" returned: 0 in 1.180s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:53 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Lock "cinder-quobyte-3bfbced2-4c77-4106-a4c9-fab101ad2861" released by "_delete_snapshot" :: held 5.135s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:46:53 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Lock "cinder-quobyte-caea6718-b02a-445a-ae9d-109c47bded06" released by "delete_snapshot" :: held 5.197s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:46:53 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Created reservations ['5aa11646-741f-46a2-aad3-249a88809388', '493c8aab-7386-47b9-b59c-13bc4c7ea069', 'b5b5b150-738b-4c74-8319-fe4cdb2f6fdb', 'c1371df0-f4ae-4b25-8b9b-675940cbf224'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:46:53 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Delete snapshot completed successfully. Jul 06 20:46:53 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f7947d1d-f75a-4c48-bdcb-f07cb48b1d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Lock "cinder-3bfbced2-4c77-4106-a4c9-fab101ad2861-delete_snapshot" released by "delete_snapshot" :: held 5.624s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:46:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Acquiring lock "cinder-caea6718-b02a-445a-ae9d-109c47bded06-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:46:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Lock "cinder-caea6718-b02a-445a-ae9d-109c47bded06-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:46:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Acquiring lock "cinder-quobyte-caea6718-b02a-445a-ae9d-109c47bded06" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:46:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Lock "cinder-quobyte-caea6718-b02a-445a-ae9d-109c47bded06" acquired by "delete_volume" :: waited 0.039s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:46:55 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b44f4e7-baf7-4d76-b89b-a1fbc1e50a4b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:46:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:55 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06 Jul 06 20:46:55 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:56 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06" returned: 0 in 1.271s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:56 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06 Jul 06 20:46:56 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:57 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-caea6718-b02a-445a-ae9d-109c47bded06" returned: 0 in 0.966s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Lock "cinder-quobyte-caea6718-b02a-445a-ae9d-109c47bded06" released by "delete_volume" :: held 2.360s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:46:57 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Created reservations ['3a78ce5e-8199-4235-8ae6-0768e5ac4c75', '19a651aa-f53c-4718-8f92-e9d2b2d50d60', 'a7c4e02e-d2ec-4164-ac69-78f0a7f964a4', 'f3701501-ba97-4c66-a091-d247ff13d1b0'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:46:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:46:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:46:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:46:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:46:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:46:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:57 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:46:57 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:57 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:46:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:46:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:46:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:46:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:46:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:46:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:46:58 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:46:58 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:46:58 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.412s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:46:58 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Deleted volume successfully. Jul 06 20:46:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5cfdf7c2-a662-4e2f-8c10-83138c0eea9e tempest-VolumeSnapshotQuotasNegativeTestJSON-451216756 None] Lock "cinder-caea6718-b02a-445a-ae9d-109c47bded06-delete_volume" released by "delete_volume" :: held 4.160s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:46:59 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Jul 06 20:46:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.382s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:46:59 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:46:59 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:46:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 8 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:46:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Flow 'volume_create_manager' (3c9087ca-a47a-47b3-8731-3bc587e07328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162dd287-6fd3-4905-98c5-c9df4b7913e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162dd287-6fd3-4905-98c5-c9df4b7913e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1813985943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b273ca33-d381-4404-99e0-632faf53098d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2023ee48c2c4ce3be43d8ffc56ca2a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:47:09Z,use_quota=True,user_id='3c8abc59b5a74766abcedc64c7f2edcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd83ae8c-0306-41fa-ac5f-503eae2ab468),volume_type_id=fd83ae8c-0306-41fa-ac5f-503eae2ab468)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc1d68a-6889-4c0b-8189-22638f4c1b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc1d68a-6889-4c0b-8189-22638f4c1b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503266d8-c826-4f37-8844-fbaa73905164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503266d8-c826-4f37-8844-fbaa73905164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b273ca33-d381-4404-99e0-632faf53098d', 'volume_name': 'volume-b273ca33-d381-4404-99e0-632faf53098d', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d358aeee-b283-4107-a0e8-6d3c9a5c5c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d358aeee-b283-4107-a0e8-6d3c9a5c5c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4640f047-7893-453f-9c8d-b4c66c5180df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:09 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Volume b273ca33-d381-4404-99e0-632faf53098d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b273ca33-d381-4404-99e0-632faf53098d', 'volume_size': 1} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1813985943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b273ca33-d381-4404-99e0-632faf53098d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2023ee48c2c4ce3be43d8ffc56ca2a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:47:09Z,use_quota=True,user_id='3c8abc59b5a74766abcedc64c7f2edcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd83ae8c-0306-41fa-ac5f-503eae2ab468),volume_type_id=fd83ae8c-0306-41fa-ac5f-503eae2ab468)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Creating volume b273ca33-d381-4404-99e0-632faf53098d {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:47:09 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:47:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b273ca33-d381-4404-99e0-632faf53098d 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:09 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b273ca33-d381-4404-99e0-632faf53098d 1073741824 Jul 06 20:47:09 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-ec8f7d7a-7d79-4df0-96b2-774c05872bd2 req-7593ff2a-06be-4a08-a2c4-5a03d7d562da tempest-AttachVolumeShelveTestJSON-222273946 None] No connector for attachment 7cef6d80-c3ce-42db-a46f-d8d1e77a9e59; skipping storage backend terminate_connection call. {{(pid=87207) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 06 20:47:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-ec8f7d7a-7d79-4df0-96b2-774c05872bd2 req-7593ff2a-06be-4a08-a2c4-5a03d7d562da tempest-AttachVolumeShelveTestJSON-222273946 None] Deleting attachment 7cef6d80-c3ce-42db-a46f-d8d1e77a9e59. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 20:47:10 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b273ca33-d381-4404-99e0-632faf53098d 1073741824" returned: 0 in 0.917s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b273ca33-d381-4404-99e0-632faf53098d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:10 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b273ca33-d381-4404-99e0-632faf53098d Jul 06 20:47:10 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:11 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b273ca33-d381-4404-99e0-632faf53098d" returned: 0 in 0.765s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:47:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:47:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4640f047-7893-453f-9c8d-b4c66c5180df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b273ca33-d381-4404-99e0-632faf53098d', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c137e3-7463-45a3-9f51-43c49febdce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:11 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Volume volume-b273ca33-d381-4404-99e0-632faf53098d (b273ca33-d381-4404-99e0-632faf53098d): created successfully Jul 06 20:47:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c137e3-7463-45a3-9f51-43c49febdce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Flow 'volume_create_manager' (3c9087ca-a47a-47b3-8731-3bc587e07328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:47:11 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-06d4328f-51a7-460e-81d6-40336367e978 tempest-VolumeTypesAccessTest-984891158 None] Created volume successfully. Jul 06 20:47:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Acquiring lock "cinder-b273ca33-d381-4404-99e0-632faf53098d-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:47:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Lock "cinder-b273ca33-d381-4404-99e0-632faf53098d-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:47:12 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Acquiring lock "cinder-quobyte-b273ca33-d381-4404-99e0-632faf53098d" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:47:12 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Lock "cinder-quobyte-b273ca33-d381-4404-99e0-632faf53098d" acquired by "delete_volume" :: waited 0.050s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:47:12 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1acaf10-972d-4efb-ab95-fd88e4e97334]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:47:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b273ca33-d381-4404-99e0-632faf53098d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:12 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b273ca33-d381-4404-99e0-632faf53098d Jul 06 20:47:12 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:13 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b273ca33-d381-4404-99e0-632faf53098d" returned: 0 in 1.540s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b273ca33-d381-4404-99e0-632faf53098d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:13 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b273ca33-d381-4404-99e0-632faf53098d Jul 06 20:47:13 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:14 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b273ca33-d381-4404-99e0-632faf53098d" returned: 0 in 1.065s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Lock "cinder-quobyte-b273ca33-d381-4404-99e0-632faf53098d" released by "delete_volume" :: held 2.709s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:47:14 devstack cinder-volume[87207]: WARNING cinder.quota [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-350341840 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-350341840, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:47:14 devstack cinder-volume[87207]: WARNING cinder.quota [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-350341840 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-350341840, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:47:14 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Created reservations ['80af3dc7-2d0b-4c1d-aeca-8b79fbd0553f', 'da1ae14f-c9d3-4c11-9b83-4d1ddef1be37', '609e4abe-96c6-46e9-9df3-da64bf7457e4', '79e2956d-0090-4988-8528-4e2525234b04'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:47:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:47:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:47:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:47:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:47:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:47:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:15 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:47:15 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:15 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.963s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:15 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:47:15 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Deleted volume successfully. Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-855dff19-bc02-4480-8338-508477e9750b tempest-VolumeTypesAccessTest-984891158 None] Lock "cinder-b273ca33-d381-4404-99e0-632faf53098d-delete_volume" released by "delete_volume" :: held 4.043s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Flow 'volume_create_manager' (e360cd4a-7b0b-4475-a982-eb498b409b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78bf8fa3-e5e6-47a4-b65e-06439ebbb443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78bf8fa3-e5e6-47a4-b65e-06439ebbb443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-498146214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d1a148-38cf-48a6-a780-0107015229c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2873dd335e614713af24b43a72093856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:47:16Z,use_quota=True,user_id='81902abca81c42ee913b78f4bef01289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de25241-6cbb-42a5-816c-394299551472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de25241-6cbb-42a5-816c-394299551472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc55cb8-7c33-41e3-85f1-9150dd6c589f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc55cb8-7c33-41e3-85f1-9150dd6c589f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84d1a148-38cf-48a6-a780-0107015229c9', 'volume_name': 'volume-84d1a148-38cf-48a6-a780-0107015229c9', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf6a4e7-6c73-49ef-a73b-34f7f44d960d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf6a4e7-6c73-49ef-a73b-34f7f44d960d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a44405-1fbe-4066-b945-160fc0777de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:16 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Volume 84d1a148-38cf-48a6-a780-0107015229c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84d1a148-38cf-48a6-a780-0107015229c9', 'volume_size': 1} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-498146214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d1a148-38cf-48a6-a780-0107015229c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2873dd335e614713af24b43a72093856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:47:16Z,use_quota=True,user_id='81902abca81c42ee913b78f4bef01289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Creating volume 84d1a148-38cf-48a6-a780-0107015229c9 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:47:16 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:47:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-84d1a148-38cf-48a6-a780-0107015229c9 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:16 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-84d1a148-38cf-48a6-a780-0107015229c9 1073741824 Jul 06 20:47:16 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:17 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-84d1a148-38cf-48a6-a780-0107015229c9 1073741824" returned: 0 in 1.144s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-84d1a148-38cf-48a6-a780-0107015229c9 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:17 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-84d1a148-38cf-48a6-a780-0107015229c9 Jul 06 20:47:17 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:18 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-84d1a148-38cf-48a6-a780-0107015229c9" returned: 0 in 0.832s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:47:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:47:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a44405-1fbe-4066-b945-160fc0777de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84d1a148-38cf-48a6-a780-0107015229c9', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0078cbd1-dedf-4e2f-8171-d2c5bc82a58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:18 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Volume volume-84d1a148-38cf-48a6-a780-0107015229c9 (84d1a148-38cf-48a6-a780-0107015229c9): created successfully Jul 06 20:47:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0078cbd1-dedf-4e2f-8171-d2c5bc82a58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Flow 'volume_create_manager' (e360cd4a-7b0b-4475-a982-eb498b409b15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:47:18 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9773f77d-3f55-4e83-8b2b-fdebd6f24bf4 tempest-ServerActionsTestOtherA-217336690 None] Created volume successfully. Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Flow 'volume_create_manager' (0e6f8a0a-ae18-4983-93af-c6e6b8e0df09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e6a3c5-5e06-4706-a453-a562c7e38cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e6a3c5-5e06-4706-a453-a562c7e38cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-696852661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb461866-c17f-4f19-9c68-10a705bb4255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e88cf2f7f41482c908abbffd02e37cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:47:23Z,use_quota=True,user_id='9dffb7257ccd4c2580bdc47acc8724f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f43e5b-2d37-4758-8757-25c794216d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f43e5b-2d37-4758-8757-25c794216d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b0bb6d-51c3-4e75-9d80-f0220247efb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b0bb6d-51c3-4e75-9d80-f0220247efb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb461866-c17f-4f19-9c68-10a705bb4255', 'volume_name': 'volume-cb461866-c17f-4f19-9c68-10a705bb4255', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50efc5a8-c7bb-4c86-a278-4eabc2927296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50efc5a8-c7bb-4c86-a278-4eabc2927296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdc2e4d-dc65-4489-849c-5c0e6aa7d602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:22 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Volume cb461866-c17f-4f19-9c68-10a705bb4255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb461866-c17f-4f19-9c68-10a705bb4255', 'volume_size': 1} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-696852661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb461866-c17f-4f19-9c68-10a705bb4255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e88cf2f7f41482c908abbffd02e37cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:47:23Z,use_quota=True,user_id='9dffb7257ccd4c2580bdc47acc8724f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Creating volume cb461866-c17f-4f19-9c68-10a705bb4255 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:47:22 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:47:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cb461866-c17f-4f19-9c68-10a705bb4255 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:23 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cb461866-c17f-4f19-9c68-10a705bb4255 1073741824 Jul 06 20:47:23 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:24 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cb461866-c17f-4f19-9c68-10a705bb4255 1073741824" returned: 0 in 1.140s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cb461866-c17f-4f19-9c68-10a705bb4255 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:24 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cb461866-c17f-4f19-9c68-10a705bb4255 Jul 06 20:47:24 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:24 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cb461866-c17f-4f19-9c68-10a705bb4255" returned: 0 in 0.794s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] <== create_volume: return (1995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:47:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:47:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdc2e4d-dc65-4489-849c-5c0e6aa7d602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb461866-c17f-4f19-9c68-10a705bb4255', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d316ae-e3ab-4ace-816c-970f7d429ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:25 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Volume volume-cb461866-c17f-4f19-9c68-10a705bb4255 (cb461866-c17f-4f19-9c68-10a705bb4255): created successfully Jul 06 20:47:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d316ae-e3ab-4ace-816c-970f7d429ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Flow 'volume_create_manager' (0e6f8a0a-ae18-4983-93af-c6e6b8e0df09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:47:25 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-002c6269-e4a8-4b82-9885-52b548711fd4 tempest-ServersNegativeTestJSON-781113424 None] Created volume successfully. Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Flow 'volume_create_manager' (1fb48406-0855-4e48-8a68-7b5252714ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ad0dbd-452c-4b1b-8022-cb7d777d0d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ad0dbd-452c-4b1b-8022-cb7d777d0d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1947297596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=039b475f-7392-4c29-8dba-e00b9f3d799f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e88cf2f7f41482c908abbffd02e37cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:47:28Z,use_quota=True,user_id='9dffb7257ccd4c2580bdc47acc8724f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1dfd1b-e912-421e-8f8b-7478aefbf7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1dfd1b-e912-421e-8f8b-7478aefbf7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a199b93d-5c53-4765-92e9-8a31a4d567f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a199b93d-5c53-4765-92e9-8a31a4d567f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '039b475f-7392-4c29-8dba-e00b9f3d799f', 'volume_name': 'volume-039b475f-7392-4c29-8dba-e00b9f3d799f', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67a654a-98e1-41d2-8c3a-7d3424b099b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67a654a-98e1-41d2-8c3a-7d3424b099b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0cda0c-6591-448c-931c-a48995c830d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:28 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Volume 039b475f-7392-4c29-8dba-e00b9f3d799f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-039b475f-7392-4c29-8dba-e00b9f3d799f', 'volume_size': 1} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1947297596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=039b475f-7392-4c29-8dba-e00b9f3d799f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e88cf2f7f41482c908abbffd02e37cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:47:28Z,use_quota=True,user_id='9dffb7257ccd4c2580bdc47acc8724f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Creating volume 039b475f-7392-4c29-8dba-e00b9f3d799f {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:47:28 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:47:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-039b475f-7392-4c29-8dba-e00b9f3d799f 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:28 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-039b475f-7392-4c29-8dba-e00b9f3d799f 1073741824 Jul 06 20:47:28 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:29 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-039b475f-7392-4c29-8dba-e00b9f3d799f 1073741824" returned: 0 in 0.958s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:29 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=34,cinder:UPDATE=38,cinder:DELETE=5,cinder:INSERT=10 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:47:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-039b475f-7392-4c29-8dba-e00b9f3d799f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:29 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-039b475f-7392-4c29-8dba-e00b9f3d799f Jul 06 20:47:29 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:30 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:47:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Flow 'volume_create_manager' (17b5cc57-0b0b-4faa-a063-8f6497ff9966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:47:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f264826-1093-4b3e-b658-088c0222541d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f264826-1093-4b3e-b658-088c0222541d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-312646470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e154148-93ee-4a13-a49d-89149173d03c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6845e3c1ab4a5488a661324c13e905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:47:31Z,use_quota=True,user_id='9b9d51b6a0fa4d3a85ea850f2acd83e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:30 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e684a5be-f347-489f-a665-7bbccaefde20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e684a5be-f347-489f-a665-7bbccaefde20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632276dd-96a6-41dc-8fe9-91a4489c7334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632276dd-96a6-41dc-8fe9-91a4489c7334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e154148-93ee-4a13-a49d-89149173d03c', 'volume_name': 'volume-1e154148-93ee-4a13-a49d-89149173d03c', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c8c873-5eec-47ae-bbaf-637002679bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c8c873-5eec-47ae-bbaf-637002679bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b06d37a-8452-4f91-8334-8045420bcc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:30 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Volume 1e154148-93ee-4a13-a49d-89149173d03c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e154148-93ee-4a13-a49d-89149173d03c', 'volume_size': 1} Jul 06 20:47:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:47:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-039b475f-7392-4c29-8dba-e00b9f3d799f" returned: 0 in 1.281s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] <== create_volume: return (2286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:47:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:47:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:47:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-312646470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e154148-93ee-4a13-a49d-89149173d03c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6845e3c1ab4a5488a661324c13e905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:47:31Z,use_quota=True,user_id='9b9d51b6a0fa4d3a85ea850f2acd83e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:47:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Creating volume 1e154148-93ee-4a13-a49d-89149173d03c {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:47:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:47:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:47:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:47:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:47:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:47:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:47:31 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:47:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:31 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c 1073741824 Jul 06 20:47:31 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0cda0c-6591-448c-931c-a48995c830d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-039b475f-7392-4c29-8dba-e00b9f3d799f', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e150eeac-ce76-42de-ad9e-ce8e9003f5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:31 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Volume volume-039b475f-7392-4c29-8dba-e00b9f3d799f (039b475f-7392-4c29-8dba-e00b9f3d799f): created successfully Jul 06 20:47:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e150eeac-ce76-42de-ad9e-ce8e9003f5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Flow 'volume_create_manager' (1fb48406-0855-4e48-8a68-7b5252714ce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:47:31 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-b6de9c2e-d4d1-47df-aeb9-9b6c54df31f2 tempest-ServersNegativeTestJSON-781113424 None] Created volume successfully. Jul 06 20:47:32 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c 1073741824" returned: 0 in 1.133s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:32 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c Jul 06 20:47:32 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] Acquiring lock "cinder-039b475f-7392-4c29-8dba-e00b9f3d799f-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:47:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] Lock "cinder-039b475f-7392-4c29-8dba-e00b9f3d799f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:47:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] Acquiring lock "cinder-quobyte-039b475f-7392-4c29-8dba-e00b9f3d799f" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:47:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] Lock "cinder-quobyte-039b475f-7392-4c29-8dba-e00b9f3d799f" acquired by "delete_volume" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:47:32 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cd953c-968b-4021-b61d-1fffab25ac12]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:47:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-039b475f-7392-4c29-8dba-e00b9f3d799f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:32 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-039b475f-7392-4c29-8dba-e00b9f3d799f Jul 06 20:47:32 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:33 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c" returned: 0 in 0.861s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:47:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:47:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b06d37a-8452-4f91-8334-8045420bcc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e154148-93ee-4a13-a49d-89149173d03c', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe30e9c-990b-4afc-8b2a-6a012e8ec211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:47:33 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Volume volume-1e154148-93ee-4a13-a49d-89149173d03c (1e154148-93ee-4a13-a49d-89149173d03c): created successfully Jul 06 20:47:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe30e9c-990b-4afc-8b2a-6a012e8ec211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:47:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Flow 'volume_create_manager' (17b5cc57-0b0b-4faa-a063-8f6497ff9966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:47:33 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-186a0dc9-51c5-4f74-9c9f-b3a3cd5ba528 tempest-SnapshotMetadataTestJSON-948745176 None] Created volume successfully. Jul 06 20:47:33 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-039b475f-7392-4c29-8dba-e00b9f3d799f" returned: 0 in 1.375s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-039b475f-7392-4c29-8dba-e00b9f3d799f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:33 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-039b475f-7392-4c29-8dba-e00b9f3d799f Jul 06 20:47:33 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:47:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:47:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] Creating offline snapshot f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2 of volume 1e154148-93ee-4a13-a49d-89149173d03c {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:47:34 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0881a7c5-6593-47b0-8e19-1e094012c7cb]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:47:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:34 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c Jul 06 20:47:34 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:34 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-039b475f-7392-4c29-8dba-e00b9f3d799f" returned: 0 in 1.024s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] Lock "cinder-quobyte-039b475f-7392-4c29-8dba-e00b9f3d799f" released by "delete_volume" :: held 2.451s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:47:34 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] Created reservations ['c03b115f-538a-4798-bab9-b1dae3339a5b', '310912cc-c362-4309-9488-962b91371082', 'b82fc6f5-27ca-454b-bebb-85662e177f58', 'd6183df5-560e-4828-94ff-04c5989baa67'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:47:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:47:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:47:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:47:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:47:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:47:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:35 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:47:35 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] Acquiring lock "cinder-cb461866-c17f-4f19-9c68-10a705bb4255-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:47:35 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c" returned: 0 in 1.438s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] Lock "cinder-cb461866-c17f-4f19-9c68-10a705bb4255-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:47:35 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2 1G Jul 06 20:47:35 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] Acquiring lock "cinder-quobyte-cb461866-c17f-4f19-9c68-10a705bb4255" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:47:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] Lock "cinder-quobyte-cb461866-c17f-4f19-9c68-10a705bb4255" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:47:36 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:36 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff10395-d436-40cb-8f83-54a9e46b1bc7]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:47:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cb461866-c17f-4f19-9c68-10a705bb4255 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.027s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:36 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:47:36 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] Deleted volume successfully. Jul 06 20:47:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-118a7cf1-b84a-43ea-9c08-9f23af6dd311 tempest-ServersNegativeTestJSON-781113424 None] Lock "cinder-039b475f-7392-4c29-8dba-e00b9f3d799f-delete_volume" released by "delete_volume" :: held 3.870s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:47:36 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cb461866-c17f-4f19-9c68-10a705bb4255 Jul 06 20:47:36 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:37 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2 1G" returned: 0 in 1.413s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e154148-93ee-4a13-a49d-89149173d03c -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:37 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e154148-93ee-4a13-a49d-89149173d03c -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2 Jul 06 20:47:37 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:37 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cb461866-c17f-4f19-9c68-10a705bb4255" returned: 0 in 1.565s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cb461866-c17f-4f19-9c68-10a705bb4255 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:37 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cb461866-c17f-4f19-9c68-10a705bb4255 Jul 06 20:47:37 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:38 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cb461866-c17f-4f19-9c68-10a705bb4255" returned: 0 in 0.896s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] Lock "cinder-quobyte-cb461866-c17f-4f19-9c68-10a705bb4255" released by "delete_volume" :: held 2.552s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:47:38 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:UPDATE=55,cinder:SELECT=43,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:47:38 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] Created reservations ['779deee2-e0ed-4ba8-b542-69f068da21b5', '277c50c4-c536-4f11-a260-b7f40e360f2d', '3e24531d-18f1-4cb3-85bc-6bb04d10927e', '5b19eef6-635c-4a62-a031-2cf7d68607d7'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:47:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:47:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:47:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:47:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:47:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:47:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:38 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:47:38 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:38 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e154148-93ee-4a13-a49d-89149173d03c -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2" returned: 0 in 1.558s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:38 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2 is being set with open permissions: ugo+rw Jul 06 20:47:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:38 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2 Jul 06 20:47:38 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:40 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.292s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:40 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:47:40 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] Deleted volume successfully. Jul 06 20:47:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7926d227-646a-4bfd-94ff-9e48c3441f29 tempest-ServersNegativeTestJSON-781113424 None] Lock "cinder-cb461866-c17f-4f19-9c68-10a705bb4255-delete_volume" released by "delete_volume" :: held 4.239s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:47:40 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2" returned: 0 in 1.623s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:40 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.info Jul 06 20:47:40 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:41 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.info" returned: 0 in 0.851s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:41 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.info is being set with open permissions: ugo+rw Jul 06 20:47:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:41 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.info Jul 06 20:47:41 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:42 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.info" returned: 0 in 1.156s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.188s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:47:42 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e284f1f3-ba2f-4cf4-8a1b-513da78a807c tempest-SnapshotMetadataTestJSON-948745176 None] Create snapshot completed successfully Jul 06 20:47:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] Acquiring lock "cinder-f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:47:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] Lock "cinder-f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:47:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] Acquiring lock "cinder-quobyte-1e154148-93ee-4a13-a49d-89149173d03c" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:47:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] Lock "cinder-quobyte-1e154148-93ee-4a13-a49d-89149173d03c" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:47:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] Acquiring lock "cinder-quobyte-f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:47:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] Lock "cinder-quobyte-f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:47:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] Deleting offline snapshot f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2 of volume 1e154148-93ee-4a13-a49d-89149173d03c {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:47:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] snapshot_file for this snap is: volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:47:44 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f00f19-eba7-473b-89ac-93694069c055]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:47:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:44 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2 Jul 06 20:47:44 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:45 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2" returned: 0 in 0.898s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e154148-93ee-4a13-a49d-89149173d03c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:47:45 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c44ac6-006d-4294-808e-09601eeef9f8]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:47:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:45 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c Jul 06 20:47:45 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:46 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c" returned: 0 in 0.937s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:46 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2 Jul 06 20:47:46 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:46 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2" returned: 0 in 0.806s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:46 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2 Jul 06 20:47:46 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:47 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c.f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2" returned: 0 in 0.674s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:47 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] Lock "cinder-quobyte-f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2" released by "_delete_snapshot" :: held 3.429s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:47:47 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] Lock "cinder-quobyte-1e154148-93ee-4a13-a49d-89149173d03c" released by "delete_snapshot" :: held 3.453s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:47:47 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] Created reservations ['41ed44f3-86cb-491e-8d5a-4293fd3c683b', '2c2eec5b-88c2-473c-a3ed-79b447b0a456', 'bd07c2f1-19f6-4226-97d6-281ffc727408', 'b3a882b9-c80c-4f91-bffd-87a0b05ba701'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:47:47 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] Delete snapshot completed successfully. Jul 06 20:47:47 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f079e1b9-4010-432f-8d74-8bf32c7ca319 tempest-SnapshotMetadataTestJSON-948745176 None] Lock "cinder-f14c9bf4-bd6f-4c40-a2ec-c2bea7e7aec2-delete_snapshot" released by "delete_snapshot" :: held 3.636s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:47:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] Acquiring lock "cinder-1e154148-93ee-4a13-a49d-89149173d03c-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:47:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] Lock "cinder-1e154148-93ee-4a13-a49d-89149173d03c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:47:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] Acquiring lock "cinder-quobyte-1e154148-93ee-4a13-a49d-89149173d03c" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:47:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] Lock "cinder-quobyte-1e154148-93ee-4a13-a49d-89149173d03c" acquired by "delete_volume" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:47:48 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cb6ba1-7ace-423e-8dde-4944408a4b98]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:47:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:48 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c Jul 06 20:47:48 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:49 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c" returned: 0 in 0.838s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:49 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c Jul 06 20:47:49 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:50 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1e154148-93ee-4a13-a49d-89149173d03c" returned: 0 in 0.687s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] Lock "cinder-quobyte-1e154148-93ee-4a13-a49d-89149173d03c" released by "delete_volume" :: held 1.588s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:47:50 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] Created reservations ['cc723c4a-8c6b-463b-886d-b76921c80c13', '04a2a0e9-d965-4f79-96ea-e2feea8ab797', 'fe02a706-9d4c-470b-81a5-aadad9ec7edd', 'd0dd7442-24e6-49c9-b053-c94d5727cdcc'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:47:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:47:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:47:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:47:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:47:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:47:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:50 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:47:50 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:51 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.856s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:51 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:47:51 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] Deleted volume successfully. Jul 06 20:47:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bd8f40c8-1626-4332-9f1a-0acbbe109f22 tempest-SnapshotMetadataTestJSON-948745176 None] Lock "cinder-1e154148-93ee-4a13-a49d-89149173d03c-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:47:57 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:47:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:47:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:47:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:47:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:47:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:47:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:47:58 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:47:58 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:47:58 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Jul 06 20:47:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.727s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:47:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:47:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:47:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 8 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:47:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:48:00 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:UPDATE=31,cinder:SELECT=23,cinder:DELETE=4,cinder:INSERT=10 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:48:01 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:UPDATE=27,cinder:SELECT=17,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Flow 'volume_create_manager' (b100c750-f7c2-44e0-90a3-3370df984e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57249bf-5ef3-4b4e-8e90-6c2eec7dcdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57249bf-5ef3-4b4e-8e90-6c2eec7dcdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-446079553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482edc94-43d5-4a1e-af67-de5d40b244dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db32387c3a5469c8057f9efeeb485c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:48:10Z,use_quota=True,user_id='6074b04f0d52438696eaea3d50725977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9816c7f-d8b3-4e02-a3c5-0321ef01ee5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9816c7f-d8b3-4e02-a3c5-0321ef01ee5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f05cc75-873b-47fe-bccc-0a5801da17ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f05cc75-873b-47fe-bccc-0a5801da17ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '482edc94-43d5-4a1e-af67-de5d40b244dc', 'volume_name': 'volume-482edc94-43d5-4a1e-af67-de5d40b244dc', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1435c8b6-2dae-4e38-ada6-29ef16b5bd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1435c8b6-2dae-4e38-ada6-29ef16b5bd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4410f32f-3edd-43e5-a468-3b9e42c7a2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:48:10 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Volume 482edc94-43d5-4a1e-af67-de5d40b244dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-482edc94-43d5-4a1e-af67-de5d40b244dc', 'volume_size': 1} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-446079553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482edc94-43d5-4a1e-af67-de5d40b244dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db32387c3a5469c8057f9efeeb485c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:48:10Z,use_quota=True,user_id='6074b04f0d52438696eaea3d50725977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Creating volume 482edc94-43d5-4a1e-af67-de5d40b244dc {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:48:10 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:48:10 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc 1073741824 Jul 06 20:48:10 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] Acquiring lock "cinder-bccb1c52-c75a-4229-9a13-e5f06690a986-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] Lock "cinder-bccb1c52-c75a-4229-9a13-e5f06690a986-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] Acquiring lock "cinder-quobyte-bccb1c52-c75a-4229-9a13-e5f06690a986" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] Lock "cinder-quobyte-bccb1c52-c75a-4229-9a13-e5f06690a986" acquired by "delete_volume" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1fd0f0-226e-49b2-8b9e-504aad01f43c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:48:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bccb1c52-c75a-4229-9a13-e5f06690a986 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:48:10 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bccb1c52-c75a-4229-9a13-e5f06690a986 Jul 06 20:48:10 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:48:11 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Jul 06 20:48:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc 1073741824" returned: 0 in 0.932s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:48:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:48:11 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc Jul 06 20:48:11 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:48:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-c2b5d37b-c6b6-48ab-889a-04fd6e99c454 req-abfe248f-63d9-4d36-99a5-ab47f3718613 tempest-ServerActionsTestOtherA-217336690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:48:11 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Jul 06 20:48:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bccb1c52-c75a-4229-9a13-e5f06690a986" returned: 0 in 0.898s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:48:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bccb1c52-c75a-4229-9a13-e5f06690a986 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:48:11 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bccb1c52-c75a-4229-9a13-e5f06690a986 Jul 06 20:48:11 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:48:11 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc" returned: 0 in 0.676s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-c2b5d37b-c6b6-48ab-889a-04fd6e99c454 req-abfe248f-63d9-4d36-99a5-ab47f3718613 tempest-ServerActionsTestOtherA-217336690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.399s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4410f32f-3edd-43e5-a468-3b9e42c7a2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482edc94-43d5-4a1e-af67-de5d40b244dc', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee5be16-2425-4f69-b52e-ec6e9af94db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dd98a6-648b-4cd1-977e-e590c943c253]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-c2b5d37b-c6b6-48ab-889a-04fd6e99c454 req-abfe248f-63d9-4d36-99a5-ab47f3718613 tempest-ServerActionsTestOtherA-217336690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-84d1a148-38cf-48a6-a780-0107015229c9 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:48:12 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Volume volume-482edc94-43d5-4a1e-af67-de5d40b244dc (482edc94-43d5-4a1e-af67-de5d40b244dc): created successfully Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee5be16-2425-4f69-b52e-ec6e9af94db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Flow 'volume_create_manager' (b100c750-f7c2-44e0-90a3-3370df984e1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:48:12 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-ceec7ddc-9f38-4868-94af-2fab37032aad tempest-VolumesActionsTest-345242463 None] Created volume successfully. Jul 06 20:48:12 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-84d1a148-38cf-48a6-a780-0107015229c9 Jul 06 20:48:12 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:48:12 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bccb1c52-c75a-4229-9a13-e5f06690a986" returned: 0 in 0.740s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] Lock "cinder-quobyte-bccb1c52-c75a-4229-9a13-e5f06690a986" released by "delete_volume" :: held 1.692s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] Created reservations ['a6e8066b-aa1a-4485-a900-afb40b321c8e', '03da2c9c-594f-4dae-a695-20ff43a1f3cb', '91f1122a-8144-4393-9c33-7c9735af6759', '3e0b35c9-d21c-4a18-8550-4cc483949816'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:48:12 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:48:12 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:48:12 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-c2b5d37b-c6b6-48ab-889a-04fd6e99c454 req-abfe248f-63d9-4d36-99a5-ab47f3718613 tempest-ServerActionsTestOtherA-217336690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-84d1a148-38cf-48a6-a780-0107015229c9" returned: 0 in 0.838s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-c2b5d37b-c6b6-48ab-889a-04fd6e99c454 req-abfe248f-63d9-4d36-99a5-ab47f3718613 tempest-ServerActionsTestOtherA-217336690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.879s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:48:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-c2b5d37b-c6b6-48ab-889a-04fd6e99c454 req-abfe248f-63d9-4d36-99a5-ab47f3718613 tempest-ServerActionsTestOtherA-217336690 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-84d1a148-38cf-48a6-a780-0107015229c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8da8daec-bd26-4522-9e9b-eda0b4918d78', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 20:48:13 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-c2b5d37b-c6b6-48ab-889a-04fd6e99c454 req-abfe248f-63d9-4d36-99a5-ab47f3718613 tempest-ServerActionsTestOtherA-217336690 None] attachment_update completed successfully. Jul 06 20:48:13 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Jul 06 20:48:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.752s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:48:13 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:48:13 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] Deleted volume successfully. Jul 06 20:48:13 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-20246168-87ea-4025-8c3b-20e5e725ef02 tempest-AttachVolumeShelveTestJSON-222273946 None] Lock "cinder-bccb1c52-c75a-4229-9a13-e5f06690a986-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:48:21 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-b11f388c-9a3e-41f0-b64e-bf7410b87e7e req-8f69cbd7-9839-468f-a8e3-8d3a86c0f90b tempest-ServerActionsTestOtherA-217336690 None] Terminate volume connection completed successfully. Jul 06 20:48:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-b11f388c-9a3e-41f0-b64e-bf7410b87e7e req-8f69cbd7-9839-468f-a8e3-8d3a86c0f90b tempest-ServerActionsTestOtherA-217336690 None] Deleting attachment 8da8daec-bd26-4522-9e9b-eda0b4918d78. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 20:48:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-b11f388c-9a3e-41f0-b64e-bf7410b87e7e req-9d833981-56ee-4a65-8641-d4bec3d47941 tempest-ServerActionsTestOtherA-217336690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:48:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-b11f388c-9a3e-41f0-b64e-bf7410b87e7e req-9d833981-56ee-4a65-8641-d4bec3d47941 tempest-ServerActionsTestOtherA-217336690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:48:24 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[54eb1ff5-3e24-4f4e-8316-dbbc8d077e17]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:48:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-b11f388c-9a3e-41f0-b64e-bf7410b87e7e req-9d833981-56ee-4a65-8641-d4bec3d47941 tempest-ServerActionsTestOtherA-217336690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-84d1a148-38cf-48a6-a780-0107015229c9 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:48:24 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-84d1a148-38cf-48a6-a780-0107015229c9 Jul 06 20:48:24 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:48:26 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Jul 06 20:48:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-b11f388c-9a3e-41f0-b64e-bf7410b87e7e req-9d833981-56ee-4a65-8641-d4bec3d47941 tempest-ServerActionsTestOtherA-217336690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-84d1a148-38cf-48a6-a780-0107015229c9" returned: 0 in 1.850s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:48:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-b11f388c-9a3e-41f0-b64e-bf7410b87e7e req-9d833981-56ee-4a65-8641-d4bec3d47941 tempest-ServerActionsTestOtherA-217336690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.899s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:48:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-b11f388c-9a3e-41f0-b64e-bf7410b87e7e req-9d833981-56ee-4a65-8641-d4bec3d47941 tempest-ServerActionsTestOtherA-217336690 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-84d1a148-38cf-48a6-a780-0107015229c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f806b41-7df1-4e08-8bd6-16c24edff588', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 20:48:26 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-b11f388c-9a3e-41f0-b64e-bf7410b87e7e req-9d833981-56ee-4a65-8641-d4bec3d47941 tempest-ServerActionsTestOtherA-217336690 None] attachment_update completed successfully. Jul 06 20:48:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2df3021a-754c-44a6-8dd1-f701bf57db68 tempest-VolumesActionsTest-345242463 None] Acquiring lock "cinder-482edc94-43d5-4a1e-af67-de5d40b244dc" by "attach_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:48:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2df3021a-754c-44a6-8dd1-f701bf57db68 tempest-VolumesActionsTest-345242463 None] Lock "cinder-482edc94-43d5-4a1e-af67-de5d40b244dc" acquired by "attach_volume" :: waited 0.030s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:48:33 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-2df3021a-754c-44a6-8dd1-f701bf57db68 tempest-VolumesActionsTest-345242463 None] Attaching volume 482edc94-43d5-4a1e-af67-de5d40b244dc to instance fdfcd4bc-9dfd-4af2-a9b0-bbef88822fba at mountpoint /dev/vdb on host None. Jul 06 20:48:33 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-2df3021a-754c-44a6-8dd1-f701bf57db68 tempest-VolumesActionsTest-345242463 None] Attach volume completed successfully. Jul 06 20:48:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2df3021a-754c-44a6-8dd1-f701bf57db68 tempest-VolumesActionsTest-345242463 None] Lock "cinder-482edc94-43d5-4a1e-af67-de5d40b244dc" released by "attach_volume" :: held 0.249s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:48:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8ad33300-cbff-4319-ac2c-73f50303d74b tempest-VolumesActionsTest-345242463 None] Acquiring lock "cinder-482edc94-43d5-4a1e-af67-de5d40b244dc-detach_volume" by "detach_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:48:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8ad33300-cbff-4319-ac2c-73f50303d74b tempest-VolumesActionsTest-345242463 None] Lock "cinder-482edc94-43d5-4a1e-af67-de5d40b244dc-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:48:34 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-8ad33300-cbff-4319-ac2c-73f50303d74b tempest-VolumesActionsTest-345242463 None] Detaching volume 482edc94-43d5-4a1e-af67-de5d40b244dc from instance fdfcd4bc-9dfd-4af2-a9b0-bbef88822fba. Jul 06 20:48:34 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-8ad33300-cbff-4319-ac2c-73f50303d74b tempest-VolumesActionsTest-345242463 None] Detach volume completed successfully. Jul 06 20:48:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8ad33300-cbff-4319-ac2c-73f50303d74b tempest-VolumesActionsTest-345242463 None] Lock "cinder-482edc94-43d5-4a1e-af67-de5d40b244dc-detach_volume" released by "detach_volume" :: held 0.114s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:48:44 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=28,cinder:UPDATE=17,cinder:DELETE=1,cinder:INSERT=4 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:48:44 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=23,cinder:UPDATE=17,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Flow 'volume_create_manager' (5fd64574-2111-4d3b-9e60-b316ad76e27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb0dc34-5ba3-469f-b963-dc1d71a7b3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb0dc34-5ba3-469f-b963-dc1d71a7b3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1721484211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048e2584-4faa-4760-9e90-79ebed252910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a806883121a4fc1becc3bdeea4421bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:48:50Z,use_quota=True,user_id='ffc87e98130d46ada08885257d671248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47f4d8b-e4ad-4216-bd57-d9e57a0b1ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47f4d8b-e4ad-4216-bd57-d9e57a0b1ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e44594b-ed90-4427-9949-95f6cbc52c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e44594b-ed90-4427-9949-95f6cbc52c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '048e2584-4faa-4760-9e90-79ebed252910', 'volume_name': 'volume-048e2584-4faa-4760-9e90-79ebed252910', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef5d467-c5a8-4bd0-bc07-3a198634c77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef5d467-c5a8-4bd0-bc07-3a198634c77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd2c54a-0fb6-4500-ae67-959fce6511db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:48:50 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Volume 048e2584-4faa-4760-9e90-79ebed252910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-048e2584-4faa-4760-9e90-79ebed252910', 'volume_size': 1} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1721484211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048e2584-4faa-4760-9e90-79ebed252910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a806883121a4fc1becc3bdeea4421bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:48:50Z,use_quota=True,user_id='ffc87e98130d46ada08885257d671248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Creating volume 048e2584-4faa-4760-9e90-79ebed252910 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:48:50 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:48:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-048e2584-4faa-4760-9e90-79ebed252910 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:48:50 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-048e2584-4faa-4760-9e90-79ebed252910 1073741824 Jul 06 20:48:50 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:48:51 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Jul 06 20:48:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-048e2584-4faa-4760-9e90-79ebed252910 1073741824" returned: 0 in 1.185s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:48:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-048e2584-4faa-4760-9e90-79ebed252910 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:48:51 devstack sudo[92435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-048e2584-4faa-4760-9e90-79ebed252910 Jul 06 20:48:51 devstack sudo[92435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:48:52 devstack sudo[92435]: pam_unix(sudo:session): session closed for user root Jul 06 20:48:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-048e2584-4faa-4760-9e90-79ebed252910" returned: 0 in 0.804s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:48:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:48:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.039s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:48:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd2c54a-0fb6-4500-ae67-959fce6511db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-048e2584-4faa-4760-9e90-79ebed252910', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:48:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17510131-1993-4b5b-a5a8-83d32860dae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:48:52 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Volume volume-048e2584-4faa-4760-9e90-79ebed252910 (048e2584-4faa-4760-9e90-79ebed252910): created successfully Jul 06 20:48:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17510131-1993-4b5b-a5a8-83d32860dae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:48:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Flow 'volume_create_manager' (5fd64574-2111-4d3b-9e60-b316ad76e27f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:48:52 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-74d58a4b-531b-4375-89c1-2f9595f8a63e tempest-AttachVolumeNegativeTest-2089758529 None] Created volume successfully. Jul 06 20:48:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-c4edf93b-e20c-4cf7-8893-ffd84ad4dcfa req-223f6c32-a118-4f45-8b87-7d31897eece4 tempest-AttachVolumeNegativeTest-2089758529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:48:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-c4edf93b-e20c-4cf7-8893-ffd84ad4dcfa req-223f6c32-a118-4f45-8b87-7d31897eece4 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:48:56 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b24d6d-9b4d-4fc1-b930-8b2dbd0dc90a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:48:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-c4edf93b-e20c-4cf7-8893-ffd84ad4dcfa req-223f6c32-a118-4f45-8b87-7d31897eece4 tempest-AttachVolumeNegativeTest-2089758529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-048e2584-4faa-4760-9e90-79ebed252910 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:48:56 devstack sudo[92529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-048e2584-4faa-4760-9e90-79ebed252910 Jul 06 20:48:56 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:48:57 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root Jul 06 20:48:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-c4edf93b-e20c-4cf7-8893-ffd84ad4dcfa req-223f6c32-a118-4f45-8b87-7d31897eece4 tempest-AttachVolumeNegativeTest-2089758529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-048e2584-4faa-4760-9e90-79ebed252910" returned: 0 in 1.115s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:48:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-c4edf93b-e20c-4cf7-8893-ffd84ad4dcfa req-223f6c32-a118-4f45-8b87-7d31897eece4 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.136s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:48:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-c4edf93b-e20c-4cf7-8893-ffd84ad4dcfa req-223f6c32-a118-4f45-8b87-7d31897eece4 tempest-AttachVolumeNegativeTest-2089758529 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-048e2584-4faa-4760-9e90-79ebed252910', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '242d6da5-14fe-4af9-871c-53876f8bcf11', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 20:48:57 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:48:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:48:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:48:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:48:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:48:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:48:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:48:58 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:48:58 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:48:58 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-c4edf93b-e20c-4cf7-8893-ffd84ad4dcfa req-223f6c32-a118-4f45-8b87-7d31897eece4 tempest-AttachVolumeNegativeTest-2089758529 None] attachment_update completed successfully. Jul 06 20:48:59 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Jul 06 20:48:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.593s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:48:59 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:48:59 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:48:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 8 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:48:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:49:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3341bcb5-f5eb-4d37-985e-b6207c311e7a tempest-VolumesActionsTest-345242463 None] Acquiring lock "cinder-482edc94-43d5-4a1e-af67-de5d40b244dc" by "attach_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:49:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3341bcb5-f5eb-4d37-985e-b6207c311e7a tempest-VolumesActionsTest-345242463 None] Lock "cinder-482edc94-43d5-4a1e-af67-de5d40b244dc" acquired by "attach_volume" :: waited 0.032s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:49:00 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-3341bcb5-f5eb-4d37-985e-b6207c311e7a tempest-VolumesActionsTest-345242463 None] Attaching volume 482edc94-43d5-4a1e-af67-de5d40b244dc to instance d5617e89-24e7-42dd-b736-27e21a7ffdc3 at mountpoint /dev/vdb on host None. Jul 06 20:49:00 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-3341bcb5-f5eb-4d37-985e-b6207c311e7a tempest-VolumesActionsTest-345242463 None] Attach volume completed successfully. Jul 06 20:49:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3341bcb5-f5eb-4d37-985e-b6207c311e7a tempest-VolumesActionsTest-345242463 None] Lock "cinder-482edc94-43d5-4a1e-af67-de5d40b244dc" released by "attach_volume" :: held 0.172s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:49:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e8564bc3-88d8-4d6d-8161-4343eff7d9c3 tempest-VolumesActionsTest-345242463 None] Acquiring lock "cinder-482edc94-43d5-4a1e-af67-de5d40b244dc-detach_volume" by "detach_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:49:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e8564bc3-88d8-4d6d-8161-4343eff7d9c3 tempest-VolumesActionsTest-345242463 None] Lock "cinder-482edc94-43d5-4a1e-af67-de5d40b244dc-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:49:00 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e8564bc3-88d8-4d6d-8161-4343eff7d9c3 tempest-VolumesActionsTest-345242463 None] Detaching volume 482edc94-43d5-4a1e-af67-de5d40b244dc from instance d5617e89-24e7-42dd-b736-27e21a7ffdc3. Jul 06 20:49:01 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e8564bc3-88d8-4d6d-8161-4343eff7d9c3 tempest-VolumesActionsTest-345242463 None] Detach volume completed successfully. Jul 06 20:49:01 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e8564bc3-88d8-4d6d-8161-4343eff7d9c3 tempest-VolumesActionsTest-345242463 None] Lock "cinder-482edc94-43d5-4a1e-af67-de5d40b244dc-detach_volume" released by "detach_volume" :: held 0.128s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:49:04 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-59404c60-8fcd-4f08-86fa-0aaf89f2775b req-0cdfddb5-d91e-4d27-8d94-0b3c7c986a88 tempest-ServerActionsTestOtherA-217336690 None] Terminate volume connection completed successfully. Jul 06 20:49:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-59404c60-8fcd-4f08-86fa-0aaf89f2775b req-0cdfddb5-d91e-4d27-8d94-0b3c7c986a88 tempest-ServerActionsTestOtherA-217336690 None] Deleting attachment 5f806b41-7df1-4e08-8bd6-16c24edff588. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 20:49:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3571484b-af34-48f6-bd38-9b9d6daa777f tempest-VolumesActionsTest-345242463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:49:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3571484b-af34-48f6-bd38-9b9d6daa777f tempest-VolumesActionsTest-345242463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:49:12 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eb6474-e204-4500-9899-110531181f6b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:49:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3571484b-af34-48f6-bd38-9b9d6daa777f tempest-VolumesActionsTest-345242463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:12 devstack sudo[92713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc Jul 06 20:49:12 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:13 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3571484b-af34-48f6-bd38-9b9d6daa777f tempest-VolumesActionsTest-345242463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc" returned: 0 in 1.034s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:13 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[545600c4-7eff-47bb-a165-04a1210c033b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:49:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3571484b-af34-48f6-bd38-9b9d6daa777f tempest-VolumesActionsTest-345242463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:14 devstack sudo[92718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc Jul 06 20:49:14 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:14 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3571484b-af34-48f6-bd38-9b9d6daa777f tempest-VolumesActionsTest-345242463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc" returned: 0 in 0.941s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3571484b-af34-48f6-bd38-9b9d6daa777f tempest-VolumesActionsTest-345242463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.bf4f04fa-8030-424c-b920-d7123516953fnmorhs7a.img {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:14 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.bf4f04fa-8030-424c-b920-d7123516953fnmorhs7a.img Jul 06 20:49:14 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:14 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:UPDATE=6,cinder:SELECT=14,cinder:INSERT=2 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:49:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] Acquiring lock "cinder-84d1a148-38cf-48a6-a780-0107015229c9-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:49:16 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] Lock "cinder-84d1a148-38cf-48a6-a780-0107015229c9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:49:16 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] Acquiring lock "cinder-quobyte-84d1a148-38cf-48a6-a780-0107015229c9" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:49:16 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] Lock "cinder-quobyte-84d1a148-38cf-48a6-a780-0107015229c9" acquired by "delete_volume" :: waited 0.044s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:49:16 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6ef95d-da83-42b1-878e-3014f2ef5b90]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:49:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-84d1a148-38cf-48a6-a780-0107015229c9 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:16 devstack sudo[92787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-84d1a148-38cf-48a6-a780-0107015229c9 Jul 06 20:49:16 devstack sudo[92787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:18 devstack sudo[92787]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-84d1a148-38cf-48a6-a780-0107015229c9" returned: 0 in 1.777s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-84d1a148-38cf-48a6-a780-0107015229c9 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:18 devstack sudo[92792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-84d1a148-38cf-48a6-a780-0107015229c9 Jul 06 20:49:18 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-84d1a148-38cf-48a6-a780-0107015229c9" returned: 0 in 1.614s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:19 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] Lock "cinder-quobyte-84d1a148-38cf-48a6-a780-0107015229c9" released by "delete_volume" :: held 3.523s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:49:19 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] Created reservations ['d3d3fe8a-d452-4170-8dd5-48049a0ce8b9', '92cc2446-20d6-4cba-8a5b-ce7a22322526', '98cdd506-8cbc-4a15-b503-e6a1b441483c', '296905ef-96ae-4231-9c72-84c2c09d6de3'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:49:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:49:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:49:19 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:49:20 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:49:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:49:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:20 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:49:20 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:20 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3571484b-af34-48f6-bd38-9b9d6daa777f tempest-VolumesActionsTest-345242463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.bf4f04fa-8030-424c-b920-d7123516953fnmorhs7a.img" returned: 0 in 5.910s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:20 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[df38cf5b-b5c6-4001-9e62-4787cc3e218f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:49:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3571484b-af34-48f6-bd38-9b9d6daa777f tempest-VolumesActionsTest-345242463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:20 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc Jul 06 20:49:20 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:21 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.136s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:21 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:49:21 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] Deleted volume successfully. Jul 06 20:49:21 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-31a43c07-058e-444c-ac2c-0ec0dea51903 tempest-ServerActionsTestOtherA-217336690 None] Lock "cinder-84d1a148-38cf-48a6-a780-0107015229c9-delete_volume" released by "delete_volume" :: held 5.199s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:49:22 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3571484b-af34-48f6-bd38-9b9d6daa777f tempest-VolumesActionsTest-345242463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc" returned: 0 in 1.215s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:22 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-3571484b-af34-48f6-bd38-9b9d6daa777f tempest-VolumesActionsTest-345242463 None] Image conversion details: src /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc, size 1024.00 MB, duration 5.91 sec, destination /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.bf4f04fa-8030-424c-b920-d7123516953fnmorhs7a.img {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 20:49:22 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-3571484b-af34-48f6-bd38-9b9d6daa777f tempest-VolumesActionsTest-345242463 None] Converted 1024.00 MB image at 173.22 MB/s Jul 06 20:49:22 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-3571484b-af34-48f6-bd38-9b9d6daa777f tempest-VolumesActionsTest-345242463 None] bf4f04fa-8030-424c-b920-d7123516953f was raw, no need to convert to raw {{(pid=87207) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 06 20:49:27 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:49:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Flow 'volume_create_manager' (231f9d22-6494-42d8-86a0-e4b139aed2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:49:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916329eb-fafe-43bf-a4a8-ffcc3f2dffb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:49:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916329eb-fafe-43bf-a4a8-ffcc3f2dffb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1801497089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20fc10e2-9fcc-422e-9681-799bada5a26f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0303e839f35e45118ed4651165208995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:49:27Z,use_quota=True,user_id='c38c2c31563a47a089248d4db3c4704d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:49:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe72270-bb52-49d8-8144-5d7b72d863b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:49:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe72270-bb52-49d8-8144-5d7b72d863b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:49:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bac0c68-8a36-41ea-8601-a46e92d70c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:49:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bac0c68-8a36-41ea-8601-a46e92d70c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20fc10e2-9fcc-422e-9681-799bada5a26f', 'volume_name': 'volume-20fc10e2-9fcc-422e-9681-799bada5a26f', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:49:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3ac0cc-61a1-44f3-ab55-273103cd04ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:49:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3ac0cc-61a1-44f3-ab55-273103cd04ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:49:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dccd15c-dad3-4af8-9617-63aeca426cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:49:27 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Volume 20fc10e2-9fcc-422e-9681-799bada5a26f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20fc10e2-9fcc-422e-9681-799bada5a26f', 'volume_size': 1} Jul 06 20:49:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:49:37 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:49:37 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=23,cinder:INSERT=3,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:49:39 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:49:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Flow 'volume_create_manager' (ebfbbec7-63e8-4a53-8dc4-dcc773c9b74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:49:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1620c922-7ebf-4782-9f28-5d574a38b7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:49:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1620c922-7ebf-4782-9f28-5d574a38b7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1067079588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76974d10-24e7-4241-9bac-00f88d03d726,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c49a6965b01f4810aadd34aa1ba55fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:49:39Z,use_quota=True,user_id='b3ec6b0b668641e6bf5b602181be597f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:49:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e74b288-ed77-4e92-9168-f8aa6506b758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:49:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e74b288-ed77-4e92-9168-f8aa6506b758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:49:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9137a195-71db-4639-b7b2-2742893e118c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:49:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9137a195-71db-4639-b7b2-2742893e118c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76974d10-24e7-4241-9bac-00f88d03d726', 'volume_name': 'volume-76974d10-24e7-4241-9bac-00f88d03d726', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:49:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa99764-430f-4dcb-b442-257c017021b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:49:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa99764-430f-4dcb-b442-257c017021b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:49:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251b35bd-f809-46be-8d0a-b2e0f494d9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:49:39 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Volume 76974d10-24e7-4241-9bac-00f88d03d726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76974d10-24e7-4241-9bac-00f88d03d726', 'volume_size': 1} Jul 06 20:49:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:49:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3571484b-af34-48f6-bd38-9b9d6daa777f tempest-VolumesActionsTest-345242463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.352s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:49:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3571484b-af34-48f6-bd38-9b9d6daa777f tempest-VolumesActionsTest-345242463 None] Uploaded volume to glance image-id: bf4f04fa-8030-424c-b920-d7123516953f. {{(pid=87207) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 06 20:49:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.024s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:49:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1801497089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20fc10e2-9fcc-422e-9681-799bada5a26f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0303e839f35e45118ed4651165208995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:49:27Z,use_quota=True,user_id='c38c2c31563a47a089248d4db3c4704d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:49:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Creating volume 20fc10e2-9fcc-422e-9681-799bada5a26f {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:49:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:49:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:49:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:49:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:49:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:49:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:49:46 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:49:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-20fc10e2-9fcc-422e-9681-799bada5a26f 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:46 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-20fc10e2-9fcc-422e-9681-799bada5a26f 1073741824 Jul 06 20:49:46 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:46 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-3571484b-af34-48f6-bd38-9b9d6daa777f tempest-VolumesActionsTest-345242463 None] Copy volume to image completed successfully. Jul 06 20:49:47 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-20fc10e2-9fcc-422e-9681-799bada5a26f 1073741824" returned: 0 in 0.954s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-20fc10e2-9fcc-422e-9681-799bada5a26f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:47 devstack sudo[92973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-20fc10e2-9fcc-422e-9681-799bada5a26f Jul 06 20:49:47 devstack sudo[92973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:49:47 devstack sudo[92973]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-20fc10e2-9fcc-422e-9681-799bada5a26f" returned: 0 in 0.705s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.703s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1067079588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76974d10-24e7-4241-9bac-00f88d03d726,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c49a6965b01f4810aadd34aa1ba55fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:49:39Z,use_quota=True,user_id='b3ec6b0b668641e6bf5b602181be597f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Creating volume 76974d10-24e7-4241-9bac-00f88d03d726 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:49:47 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-76974d10-24e7-4241-9bac-00f88d03d726 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:47 devstack sudo[92976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-76974d10-24e7-4241-9bac-00f88d03d726 1073741824 Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dccd15c-dad3-4af8-9617-63aeca426cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20fc10e2-9fcc-422e-9681-799bada5a26f', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:49:47 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305665df-b728-460b-b9e8-64732632a9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:49:47 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Volume volume-20fc10e2-9fcc-422e-9681-799bada5a26f (20fc10e2-9fcc-422e-9681-799bada5a26f): created successfully Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305665df-b728-460b-b9e8-64732632a9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:49:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Flow 'volume_create_manager' (231f9d22-6494-42d8-86a0-e4b139aed2c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:49:48 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-4e7d54b8-7171-4ac2-a325-7e4387e81ad9 tempest-AttachVolumeTestJSON-635946371 None] Created volume successfully. Jul 06 20:49:48 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-76974d10-24e7-4241-9bac-00f88d03d726 1073741824" returned: 0 in 0.926s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-76974d10-24e7-4241-9bac-00f88d03d726 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:48 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-76974d10-24e7-4241-9bac-00f88d03d726 Jul 06 20:49:48 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:49 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-76974d10-24e7-4241-9bac-00f88d03d726" returned: 0 in 0.832s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:49:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:49:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.099s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:49:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251b35bd-f809-46be-8d0a-b2e0f494d9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76974d10-24e7-4241-9bac-00f88d03d726', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:49:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e22cc0-f9c3-47ad-a9d6-7d5c6f996cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:49:49 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a2798d-2b72-4a16-a953-89ecc50eb31c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:49:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:49 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Volume volume-76974d10-24e7-4241-9bac-00f88d03d726 (76974d10-24e7-4241-9bac-00f88d03d726): created successfully Jul 06 20:49:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e22cc0-f9c3-47ad-a9d6-7d5c6f996cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:49:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Flow 'volume_create_manager' (ebfbbec7-63e8-4a53-8dc4-dcc773c9b74d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:49:49 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-54192609-15c9-4de1-8a1e-d7e703f98b37 tempest-VolumesTestJSON-849305645 None] Created volume successfully. Jul 06 20:49:49 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc Jul 06 20:49:49 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:50 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc" returned: 0 in 0.850s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:50 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5194135-ce05-4f2f-8f71-68dd86d5e3dc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:49:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:50 devstack sudo[93042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc Jul 06 20:49:50 devstack sudo[93042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:51 devstack sudo[93042]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc" returned: 0 in 0.942s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.2d2c5098-3592-4612-8d0b-51479e6ad4f3dq91fn4m.img {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:51 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.2d2c5098-3592-4612-8d0b-51479e6ad4f3dq91fn4m.img Jul 06 20:49:51 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:51 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:49:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Flow 'volume_create_manager' (2dd84b27-8ae7-47ac-9775-3f33ce0640b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:49:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384f6dc8-e054-4a5f-a69a-ad11eb557f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:49:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384f6dc8-e054-4a5f-a69a-ad11eb557f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-848308269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58249782-e070-42c1-9b43-525a78aad92a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c49a6965b01f4810aadd34aa1ba55fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:49:52Z,use_quota=True,user_id='b3ec6b0b668641e6bf5b602181be597f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:49:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4686966-da64-4d17-a0fe-381bd00f4cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:49:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4686966-da64-4d17-a0fe-381bd00f4cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:49:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b6fd29-d245-4e4f-b63b-0b2b1a6f0be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:49:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b6fd29-d245-4e4f-b63b-0b2b1a6f0be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58249782-e070-42c1-9b43-525a78aad92a', 'volume_name': 'volume-58249782-e070-42c1-9b43-525a78aad92a', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:49:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae95457-1bf2-43cc-b53d-462ec642f168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:49:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae95457-1bf2-43cc-b53d-462ec642f168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:49:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33807ee7-024d-4d0d-8925-67c0184e566a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:49:51 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Volume 58249782-e070-42c1-9b43-525a78aad92a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58249782-e070-42c1-9b43-525a78aad92a', 'volume_size': 1} Jul 06 20:49:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:49:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-1eb2c16a-245a-4709-b4b6-dc1f526db661 req-0ad8473e-60f5-48e7-a5f1-665e67561f9d tempest-AttachVolumeTestJSON-635946371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:49:56 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.2d2c5098-3592-4612-8d0b-51479e6ad4f3dq91fn4m.img" returned: 0 in 5.074s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:56 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f7f382-f3ba-4c2b-b898-ec78baa255df]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:49:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:56 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc Jul 06 20:49:56 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:57 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc" returned: 0 in 0.907s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:57 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] Image conversion details: src /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.2d2c5098-3592-4612-8d0b-51479e6ad4f3dq91fn4m.img {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 20:49:57 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] Converted 1024.00 MB image at 201.78 MB/s Jul 06 20:49:57 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] 2d2c5098-3592-4612-8d0b-51479e6ad4f3 was raw, converting to qcow2 {{(pid=87207) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 06 20:49:57 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[35780d22-5ae2-4080-a9fc-0692038a65f9]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:49:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.2d2c5098-3592-4612-8d0b-51479e6ad4f3dq91fn4m.img {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:57 devstack sudo[93076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.2d2c5098-3592-4612-8d0b-51479e6ad4f3dq91fn4m.img Jul 06 20:49:57 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:57 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:49:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:49:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:49:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:49:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:49:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:49:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:58 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:49:58 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:58 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-4ae8b7fd-eb87-4010-95b4-aa8c77ef43d3 req-504f5f5f-a3ca-41e5-aeb9-5bc110b0ac68 tempest-AttachVolumeNegativeTest-2089758529 None] Terminate volume connection completed successfully. Jul 06 20:49:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-4ae8b7fd-eb87-4010-95b4-aa8c77ef43d3 req-504f5f5f-a3ca-41e5-aeb9-5bc110b0ac68 tempest-AttachVolumeNegativeTest-2089758529 None] Deleting attachment 242d6da5-14fe-4af9-871c-53876f8bcf11. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 20:49:58 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.2d2c5098-3592-4612-8d0b-51479e6ad4f3dq91fn4m.img" returned: 0 in 0.755s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.2d2c5098-3592-4612-8d0b-51479e6ad4f3dq91fn4m.img {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:58 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.2d2c5098-3592-4612-8d0b-51479e6ad4f3dq91fn4m.img Jul 06 20:49:58 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:58 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.693s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:49:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:49:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:49:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:49:59 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.2d2c5098-3592-4612-8d0b-51479e6ad4f3dq91fn4m.img" returned: 1 in 0.735s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.2d2c5098-3592-4612-8d0b-51479e6ad4f3dq91fn4m.img' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:49:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.2d2c5098-3592-4612-8d0b-51479e6ad4f3dq91fn4m.img /opt/stack/data/cinder/conversion/vol_upload_56bqgbwb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:59 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.2d2c5098-3592-4612-8d0b-51479e6ad4f3dq91fn4m.img /opt/stack/data/cinder/conversion/vol_upload_56bqgbwb Jul 06 20:49:59 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:49:59 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Jul 06 20:49:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.2d2c5098-3592-4612-8d0b-51479e6ad4f3dq91fn4m.img /opt/stack/data/cinder/conversion/vol_upload_56bqgbwb" returned: 0 in 0.655s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:49:59 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] Image conversion details: src /opt/stack/data/cinder/conversion/482edc94-43d5-4a1e-af67-de5d40b244dc.temp_image.2d2c5098-3592-4612-8d0b-51479e6ad4f3dq91fn4m.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_56bqgbwb {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 20:49:59 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 06 20:49:59 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[dada3c61-5c59-45f4-b1ef-a4379949bd6f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:49:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_56bqgbwb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:49:59 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_56bqgbwb Jul 06 20:49:59 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:00 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_56bqgbwb" returned: 0 in 0.739s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.164s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] Uploaded volume to glance image-id: 2d2c5098-3592-4612-8d0b-51479e6ad4f3. {{(pid=87207) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 06 20:50:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.025s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-848308269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58249782-e070-42c1-9b43-525a78aad92a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c49a6965b01f4810aadd34aa1ba55fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:49:52Z,use_quota=True,user_id='b3ec6b0b668641e6bf5b602181be597f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:50:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Creating volume 58249782-e070-42c1-9b43-525a78aad92a {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:50:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:50:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:50:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:50:01 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:50:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-58249782-e070-42c1-9b43-525a78aad92a 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:01 devstack sudo[93125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-58249782-e070-42c1-9b43-525a78aad92a 1073741824 Jul 06 20:50:01 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:01 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-4dba1d23-45cd-473e-b1f7-e7129eb22eab tempest-VolumesActionsTest-345242463 None] Copy volume to image completed successfully. Jul 06 20:50:03 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-58249782-e070-42c1-9b43-525a78aad92a 1073741824" returned: 0 in 1.200s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-58249782-e070-42c1-9b43-525a78aad92a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:03 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-58249782-e070-42c1-9b43-525a78aad92a Jul 06 20:50:03 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] Acquiring lock "cinder-482edc94-43d5-4a1e-af67-de5d40b244dc-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:50:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] Lock "cinder-482edc94-43d5-4a1e-af67-de5d40b244dc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:50:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] Acquiring lock "cinder-quobyte-482edc94-43d5-4a1e-af67-de5d40b244dc" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:50:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] Lock "cinder-quobyte-482edc94-43d5-4a1e-af67-de5d40b244dc" acquired by "delete_volume" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:50:03 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cee6df-66a5-429a-bcd3-0299e7fd1770]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:03 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc Jul 06 20:50:03 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:03 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-58249782-e070-42c1-9b43-525a78aad92a" returned: 0 in 0.797s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:50:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-1eb2c16a-245a-4709-b4b6-dc1f526db661 req-0ad8473e-60f5-48e7-a5f1-665e67561f9d tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.578s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33807ee7-024d-4d0d-8925-67c0184e566a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58249782-e070-42c1-9b43-525a78aad92a', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1979b51a-c7f5-4572-b049-7c5311d53fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:04 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4766f4-c64a-4643-ab48-201c900dd0b7]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-1eb2c16a-245a-4709-b4b6-dc1f526db661 req-0ad8473e-60f5-48e7-a5f1-665e67561f9d tempest-AttachVolumeTestJSON-635946371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-20fc10e2-9fcc-422e-9681-799bada5a26f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:04 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Volume volume-58249782-e070-42c1-9b43-525a78aad92a (58249782-e070-42c1-9b43-525a78aad92a): created successfully Jul 06 20:50:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1979b51a-c7f5-4572-b049-7c5311d53fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Flow 'volume_create_manager' (2dd84b27-8ae7-47ac-9775-3f33ce0640b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:50:04 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d6f8bd42-715b-446e-b150-fb8f30b51fee tempest-VolumesTestJSON-849305645 None] Created volume successfully. Jul 06 20:50:04 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-20fc10e2-9fcc-422e-9681-799bada5a26f Jul 06 20:50:04 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:04 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc" returned: 0 in 1.009s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:04 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc Jul 06 20:50:04 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:04 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-1eb2c16a-245a-4709-b4b6-dc1f526db661 req-0ad8473e-60f5-48e7-a5f1-665e67561f9d tempest-AttachVolumeTestJSON-635946371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-20fc10e2-9fcc-422e-9681-799bada5a26f" returned: 0 in 0.880s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-1eb2c16a-245a-4709-b4b6-dc1f526db661 req-0ad8473e-60f5-48e7-a5f1-665e67561f9d tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.939s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-1eb2c16a-245a-4709-b4b6-dc1f526db661 req-0ad8473e-60f5-48e7-a5f1-665e67561f9d tempest-AttachVolumeTestJSON-635946371 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-20fc10e2-9fcc-422e-9681-799bada5a26f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '766ccc09-1b90-4dcc-9777-0332a4ad7f3d', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 20:50:04 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-1eb2c16a-245a-4709-b4b6-dc1f526db661 req-0ad8473e-60f5-48e7-a5f1-665e67561f9d tempest-AttachVolumeTestJSON-635946371 None] attachment_update completed successfully. Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Flow 'volume_create_manager' (eb307c53-17d0-4ff1-9d3a-1a5941e9f65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a2fb9b-fd7e-4bee-a9af-ef16c208ac5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a2fb9b-fd7e-4bee-a9af-ef16c208ac5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1775082863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877f5122-379b-4aba-9b51-f93e81004534,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c49a6965b01f4810aadd34aa1ba55fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:05Z,use_quota=True,user_id='b3ec6b0b668641e6bf5b602181be597f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1db226-3528-4543-9e11-07c99bc9d4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1db226-3528-4543-9e11-07c99bc9d4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0ef282-83c1-43f5-9434-32cdec1b1b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0ef282-83c1-43f5-9434-32cdec1b1b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '877f5122-379b-4aba-9b51-f93e81004534', 'volume_name': 'volume-877f5122-379b-4aba-9b51-f93e81004534', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275428df-e8fa-4f41-b25f-ee09df5947fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275428df-e8fa-4f41-b25f-ee09df5947fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b75146d5-80aa-47a8-8569-2efdca27a707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:05 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Volume 877f5122-379b-4aba-9b51-f93e81004534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-877f5122-379b-4aba-9b51-f93e81004534', 'volume_size': 1} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1775082863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877f5122-379b-4aba-9b51-f93e81004534,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c49a6965b01f4810aadd34aa1ba55fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:05Z,use_quota=True,user_id='b3ec6b0b668641e6bf5b602181be597f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Creating volume 877f5122-379b-4aba-9b51-f93e81004534 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:50:05 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-877f5122-379b-4aba-9b51-f93e81004534 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:05 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-482edc94-43d5-4a1e-af67-de5d40b244dc" returned: 0 in 0.697s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:05 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-877f5122-379b-4aba-9b51-f93e81004534 1073741824 Jul 06 20:50:05 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] Lock "cinder-quobyte-482edc94-43d5-4a1e-af67-de5d40b244dc" released by "delete_volume" :: held 1.757s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] Created reservations ['929043a6-1350-448d-90d2-8cb35c79d29d', '1c1de4a1-e3ff-4d9c-944e-4a246e5a2361', '85a38604-8628-4867-80ea-32f46927d943', '168659ef-8fcd-42f9-88e9-67859fe67dcd'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:05 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:50:05 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:06 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.799s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:06 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:50:06 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] Deleted volume successfully. Jul 06 20:50:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0ee77fb0-1c47-4190-a4e9-927ee8e859bc tempest-VolumesActionsTest-345242463 None] Lock "cinder-482edc94-43d5-4a1e-af67-de5d40b244dc-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:50:06 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-877f5122-379b-4aba-9b51-f93e81004534 1073741824" returned: 0 in 0.996s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-877f5122-379b-4aba-9b51-f93e81004534 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:06 devstack sudo[93242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-877f5122-379b-4aba-9b51-f93e81004534 Jul 06 20:50:06 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:06 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-877f5122-379b-4aba-9b51-f93e81004534" returned: 0 in 0.820s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:50:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b75146d5-80aa-47a8-8569-2efdca27a707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-877f5122-379b-4aba-9b51-f93e81004534', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b9d924-bfdc-4d68-b7ff-a09c44d79206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:07 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Volume volume-877f5122-379b-4aba-9b51-f93e81004534 (877f5122-379b-4aba-9b51-f93e81004534): created successfully Jul 06 20:50:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b9d924-bfdc-4d68-b7ff-a09c44d79206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Flow 'volume_create_manager' (eb307c53-17d0-4ff1-9d3a-1a5941e9f65b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:50:07 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-8d0d3173-2890-455a-8314-0bdcf3f5cb5d tempest-VolumesTestJSON-849305645 None] Created volume successfully. Jul 06 20:50:09 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] Acquiring lock "cinder-877f5122-379b-4aba-9b51-f93e81004534-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:50:09 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] Lock "cinder-877f5122-379b-4aba-9b51-f93e81004534-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:50:09 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] Acquiring lock "cinder-quobyte-877f5122-379b-4aba-9b51-f93e81004534" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:50:09 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] Lock "cinder-quobyte-877f5122-379b-4aba-9b51-f93e81004534" acquired by "delete_volume" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:50:09 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e11f40f-97ed-42c4-9457-2e97a9589c8e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-877f5122-379b-4aba-9b51-f93e81004534 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:09 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-877f5122-379b-4aba-9b51-f93e81004534 Jul 06 20:50:09 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:10 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-877f5122-379b-4aba-9b51-f93e81004534" returned: 0 in 1.160s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-877f5122-379b-4aba-9b51-f93e81004534 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:10 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-877f5122-379b-4aba-9b51-f93e81004534 Jul 06 20:50:10 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:11 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-877f5122-379b-4aba-9b51-f93e81004534" returned: 0 in 0.706s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] Lock "cinder-quobyte-877f5122-379b-4aba-9b51-f93e81004534" released by "delete_volume" :: held 1.923s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:50:11 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] Created reservations ['af38d461-6a6e-4a17-a8f3-e32588b95793', '63e3f3bf-d391-48f2-9164-96c6a5af197e', '2c5e86f3-f972-4920-8390-ad6b35532eb4', '1422ea17-0188-4c5d-817c-8647716b0d33'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:50:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:50:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:50:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:11 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:50:11 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] Acquiring lock "cinder-58249782-e070-42c1-9b43-525a78aad92a-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:50:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] Lock "cinder-58249782-e070-42c1-9b43-525a78aad92a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:50:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] Acquiring lock "cinder-quobyte-58249782-e070-42c1-9b43-525a78aad92a" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:50:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] Lock "cinder-quobyte-58249782-e070-42c1-9b43-525a78aad92a" acquired by "delete_volume" :: waited 0.079s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:50:11 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3df109c-ab01-4c8a-ab56-a7e8c3eabc2a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-58249782-e070-42c1-9b43-525a78aad92a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:12 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-58249782-e070-42c1-9b43-525a78aad92a Jul 06 20:50:12 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:12 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.048s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:12 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:50:12 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] Deleted volume successfully. Jul 06 20:50:12 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-de06e5c7-ff12-4f7b-aef4-6604aadf085d tempest-VolumesTestJSON-849305645 None] Lock "cinder-877f5122-379b-4aba-9b51-f93e81004534-delete_volume" released by "delete_volume" :: held 3.232s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:50:12 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-58249782-e070-42c1-9b43-525a78aad92a" returned: 0 in 0.980s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-58249782-e070-42c1-9b43-525a78aad92a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:12 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-58249782-e070-42c1-9b43-525a78aad92a Jul 06 20:50:12 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Flow 'volume_create_manager' (9f276713-3ace-4f4e-9df2-d70613f1531d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bba0c0-894c-436c-83d2-ff9cc9b154d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bba0c0-894c-436c-83d2-ff9cc9b154d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-595200021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4ae739682a4dacbc742d09be70183c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:13Z,use_quota=True,user_id='1fb6a1828b2745e999a008570cb12b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d49eaa-0343-4034-a0e4-dab7eabcbdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d49eaa-0343-4034-a0e4-dab7eabcbdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8d7ce6-05c4-4118-8b07-c62060e2d5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8d7ce6-05c4-4118-8b07-c62060e2d5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf', 'volume_name': 'volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd0fc21-0de2-45f6-8ece-faf9657bd3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd0fc21-0de2-45f6-8ece-faf9657bd3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6590af-b2e9-4823-9657-13978a48d48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:13 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Volume fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf', 'volume_size': 1} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-595200021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4ae739682a4dacbc742d09be70183c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:13Z,use_quota=True,user_id='1fb6a1828b2745e999a008570cb12b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Creating volume fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:50:13 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:13 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf 1073741824 Jul 06 20:50:13 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:13 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-58249782-e070-42c1-9b43-525a78aad92a" returned: 0 in 0.886s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] Lock "cinder-quobyte-58249782-e070-42c1-9b43-525a78aad92a" released by "delete_volume" :: held 1.954s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] Created reservations ['0a876cf3-32a9-46d2-a3df-d81df60deeae', 'e84ca71a-98f0-41e3-9dc6-7cab98d25e29', '128d8147-5fc6-4414-a0a1-815a73cdf7a4', '676a30b5-9fa6-4110-a84b-9928601eefed'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:14 devstack sudo[93597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:50:14 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:14 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf 1073741824" returned: 0 in 1.024s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:14 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf Jul 06 20:50:14 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:14 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.716s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:14 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:50:14 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] Deleted volume successfully. Jul 06 20:50:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b3398415-5425-47e1-86e3-255960eec8db tempest-VolumesTestJSON-849305645 None] Lock "cinder-58249782-e070-42c1-9b43-525a78aad92a-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:50:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] Acquiring lock "cinder-76974d10-24e7-4241-9bac-00f88d03d726-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:50:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] Lock "cinder-76974d10-24e7-4241-9bac-00f88d03d726-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:50:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] Acquiring lock "cinder-quobyte-76974d10-24e7-4241-9bac-00f88d03d726" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:50:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] Lock "cinder-quobyte-76974d10-24e7-4241-9bac-00f88d03d726" acquired by "delete_volume" :: waited 0.026s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:50:15 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[516e6427-2d0d-42b9-8462-618b42f023a8]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-76974d10-24e7-4241-9bac-00f88d03d726 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:15 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-76974d10-24e7-4241-9bac-00f88d03d726 Jul 06 20:50:15 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:15 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf" returned: 0 in 0.777s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:50:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6590af-b2e9-4823-9657-13978a48d48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc34c22-f93f-47ba-a760-ad26fd5f99a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:15 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Volume volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf (fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf): created successfully Jul 06 20:50:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc34c22-f93f-47ba-a760-ad26fd5f99a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Flow 'volume_create_manager' (9f276713-3ace-4f4e-9df2-d70613f1531d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:50:15 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-897eefad-2c74-4a54-ab8c-f0e96720026b tempest-VolumesCloneTest-53377576 None] Created volume successfully. Jul 06 20:50:15 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-76974d10-24e7-4241-9bac-00f88d03d726" returned: 0 in 0.825s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-76974d10-24e7-4241-9bac-00f88d03d726 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:16 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-76974d10-24e7-4241-9bac-00f88d03d726 Jul 06 20:50:16 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:16 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-76974d10-24e7-4241-9bac-00f88d03d726" returned: 0 in 0.688s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:16 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] Lock "cinder-quobyte-76974d10-24e7-4241-9bac-00f88d03d726" released by "delete_volume" :: held 1.572s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:50:16 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] Created reservations ['a9dafdd1-dc5e-4d04-bf1a-d2e4a02e9e62', '862d922a-8b37-4559-9baa-977260730469', 'a1e8de88-fc85-4293-abb8-df56882490ed', '1aa31327-c0a2-4aa8-bc37-d0bf8a29fedb'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:50:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:50:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:50:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:16 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:50:16 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:16 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:50:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Flow 'volume_create_manager' (e79404e1-9806-47bc-9218-4417653a57aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:50:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb02999-7770-42f2-a27d-306f4daf95cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb02999-7770-42f2-a27d-306f4daf95cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-656816512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd59d21-9f2c-440e-8ca2-b6bdef608f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4ae739682a4dacbc742d09be70183c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:17Z,use_quota=True,user_id='1fb6a1828b2745e999a008570cb12b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b3b4c5-43a8-4520-9100-6b7efc075ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b3b4c5-43a8-4520-9100-6b7efc075ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7f0e67-a3a6-4ded-b637-e2d82a3377b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7f0e67-a3a6-4ded-b637-e2d82a3377b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8bd59d21-9f2c-440e-8ca2-b6bdef608f34', 'volume_name': 'volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34', 'volume_size': 2, 'source_volid': 'fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf', 'source_volstatus': 'available'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47dae966-dd6e-4ccc-a5e5-6599977ce8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47dae966-dd6e-4ccc-a5e5-6599977ce8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8eeb76-b0bf-4a94-a025-40b761056e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:17 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Volume 8bd59d21-9f2c-440e-8ca2-b6bdef608f34: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34', 'volume_size': 2, 'source_volid': 'fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf', 'source_volstatus': 'available'} Jul 06 20:50:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:17 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Cloning volume fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf to volume 8bd59d21-9f2c-440e-8ca2-b6bdef608f34 Jul 06 20:50:17 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Creating offline snapshot 54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 of volume fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:50:17 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a64d9dd-ed45-4a0d-ae48-4304e74dd5a2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:17 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf Jul 06 20:50:17 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:17 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.794s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:17 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:50:17 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] Deleted volume successfully. Jul 06 20:50:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-972df45d-988e-461d-8546-30ace17fc337 tempest-VolumesTestJSON-849305645 None] Lock "cinder-76974d10-24e7-4241-9bac-00f88d03d726-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:50:18 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf" returned: 0 in 0.994s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:18 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 1G Jul 06 20:50:18 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:19 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 1G" returned: 0 in 1.276s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:19 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 Jul 06 20:50:19 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:20 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0" returned: 0 in 1.089s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:20 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 is being set with open permissions: ugo+rw Jul 06 20:50:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:20 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 Jul 06 20:50:20 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:21 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0" returned: 0 in 0.956s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:21 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.info Jul 06 20:50:21 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:22 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.info" returned: 0 in 0.683s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:22 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.info is being set with open permissions: ugo+rw Jul 06 20:50:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:22 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.info Jul 06 20:50:22 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:22 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.info" returned: 0 in 0.792s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Acquiring lock "cinder-quobyte-8bd59d21-9f2c-440e-8ca2-b6bdef608f34" by "_copy_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:50:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Lock "cinder-quobyte-8bd59d21-9f2c-440e-8ca2-b6bdef608f34" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:50:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] snapshot: 54b35e8d-af1c-4d57-ad28-8535b8b8b7a0, volume: 8bd59d21-9f2c-440e-8ca2-b6bdef608f34, {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 20:50:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:50:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:50:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:23 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41fc3d8-0ced-4224-909f-dfdd73a0e08c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-afee5635-0e60-400f-9a1d-b9a1a4e43564 tempest-BackendsCapabilitiesAdminTestsJSON-205435891 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87207) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 20:50:23 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 Jul 06 20:50:23 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5124e0d7-2cd8-47d8-90db-43bc62ef501d tempest-BackendsCapabilitiesAdminTestsJSON-205435891 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87207) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 20:50:24 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0" returned: 0 in 1.577s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:50:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 20:50:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Creating direct copy from snapshot {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 20:50:24 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b40b446-0a3c-4be4-a71b-c96e82a931f5]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:25 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf Jul 06 20:50:25 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:26 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf" returned: 0 in 1.479s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:26 devstack cinder-volume[87207]: DEBUG cinder.utils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Path /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34 not found in is_blk_device check {{(pid=87207) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 20:50:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:26 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34 Jul 06 20:50:26 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:31 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=41,cinder:UPDATE=49,cinder:DELETE=3,cinder:INSERT=10 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:50:31 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=43,cinder:UPDATE=51,cinder:INSERT=13,cinder:DELETE=6 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:50:36 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34" returned: 0 in 10.063s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:36 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[696b720b-71ab-4903-92cf-1063b786b72a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:36 devstack sudo[94291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf Jul 06 20:50:36 devstack sudo[94291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:38 devstack sudo[94291]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf" returned: 0 in 1.911s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:38 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Image conversion details: src /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf, size 1024.00 MB, duration 10.07 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34 {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 20:50:38 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Converted 1024.00 MB image at 101.73 MB/s Jul 06 20:50:38 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34 is being set with open permissions: ugo+rw Jul 06 20:50:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:38 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34 Jul 06 20:50:38 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:39 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34" returned: 0 in 1.001s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Lock "cinder-quobyte-8bd59d21-9f2c-440e-8ca2-b6bdef608f34" released by "_copy_volume_from_snapshot" :: held 16.225s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:50:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Acquiring lock "cinder-quobyte-54b35e8d-af1c-4d57-ad28-8535b8b8b7a0" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:50:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Lock "cinder-quobyte-54b35e8d-af1c-4d57-ad28-8535b8b8b7a0" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:50:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Deleting offline snapshot 54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 of volume fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:50:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] snapshot_file for this snap is: volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:50:39 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f24b19-15d4-4c1a-b642-41cb2a681fbb]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:39 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 Jul 06 20:50:39 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:39 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-b3626299-bde4-4f0a-8128-3ca5d1e7c5bd tempest-GroupSnapshotsV319Test-348611754 None] Group tempest-GroupSnapshotsV319Test-Group-823756232: creating Jul 06 20:50:39 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-b3626299-bde4-4f0a-8128-3ca5d1e7c5bd tempest-GroupSnapshotsV319Test-348611754 None] Group tempest-GroupSnapshotsV319Test-Group-823756232: created successfully Jul 06 20:50:39 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-b3626299-bde4-4f0a-8128-3ca5d1e7c5bd tempest-GroupSnapshotsV319Test-348611754 None] Create group completed successfully. Jul 06 20:50:40 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0" returned: 0 in 0.978s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:50:40 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc95bdd8-2e28-40e1-a7b4-1d8d83d41342]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:40 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf Jul 06 20:50:40 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:41 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf" returned: 0 in 0.898s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:41 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 Jul 06 20:50:41 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:41 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:50:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Flow 'volume_create_manager' (d21e2645-7472-4fbb-9c05-a02adc854d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:50:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b263b08c-44a7-49c1-a65d-31de1412d600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b263b08c-44a7-49c1-a65d-31de1412d600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1674819432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b07c656-3d74-414d-80cc-01bb4c5c1418,host='devstack@QuobyteHD#QuobyteHD',id=8bdf16b9-badc-4c59-a05b-a2743f4c34bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33803d222e264b2c81a6f88410a4873a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:41Z,use_quota=True,user_id='81552c8e0ee645c496127cb06a1e7308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd2e1920-d835-4fe7-9ffc-9a6ae1514757),volume_type_id=fd2e1920-d835-4fe7-9ffc-9a6ae1514757)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58999a0f-6c66-493b-addf-f1dd0375af9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58999a0f-6c66-493b-addf-f1dd0375af9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e685a9e-f0c4-45a9-a824-b4fa3cc486cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e685a9e-f0c4-45a9-a824-b4fa3cc486cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bdf16b9-badc-4c59-a05b-a2743f4c34bb', 'volume_name': 'volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb83b30-714c-408a-9d0c-f63773ffba21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb83b30-714c-408a-9d0c-f63773ffba21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dacacc5-c86b-4132-814c-6ad35320963c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:41 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Volume 8bdf16b9-badc-4c59-a05b-a2743f4c34bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb', 'volume_size': 1} Jul 06 20:50:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:42 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0" returned: 0 in 0.978s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:42 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0 Jul 06 20:50:42 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:42 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf.54b35e8d-af1c-4d57-ad28-8535b8b8b7a0" returned: 0 in 0.662s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Lock "cinder-quobyte-54b35e8d-af1c-4d57-ad28-8535b8b8b7a0" released by "_delete_snapshot" :: held 3.616s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:50:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 25.868s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.260s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1b07c656-3d74-414d-80cc-01bb4c5c1418,created_at=2026-07-06T18:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1674819432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b07c656-3d74-414d-80cc-01bb4c5c1418,host='devstack@QuobyteHD#QuobyteHD',id=8bdf16b9-badc-4c59-a05b-a2743f4c34bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33803d222e264b2c81a6f88410a4873a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:41Z,use_quota=True,user_id='81552c8e0ee645c496127cb06a1e7308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd2e1920-d835-4fe7-9ffc-9a6ae1514757),volume_type_id=fd2e1920-d835-4fe7-9ffc-9a6ae1514757)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:50:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Creating volume 8bdf16b9-badc-4c59-a05b-a2743f4c34bb {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:50:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:50:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:50:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:50:42 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:50:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8eeb76-b0bf-4a94-a025-40b761056e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34', 'volume_size': 2, 'source_volid': 'fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf', 'source_volstatus': 'available'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:42 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb 1073741824 Jul 06 20:50:42 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d579921b-e313-4f23-bbe8-8ec19d57f40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:43 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Volume volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34 (8bd59d21-9f2c-440e-8ca2-b6bdef608f34): created successfully Jul 06 20:50:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d579921b-e313-4f23-bbe8-8ec19d57f40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Flow 'volume_create_manager' (e79404e1-9806-47bc-9218-4417653a57aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:50:43 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-99099adc-6b37-4222-92db-cc6779cfefbc tempest-VolumesCloneTest-53377576 None] Created volume successfully. Jul 06 20:50:43 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb 1073741824" returned: 0 in 0.809s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:43 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb Jul 06 20:50:43 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] Acquiring lock "cinder-8bd59d21-9f2c-440e-8ca2-b6bdef608f34-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:50:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] Lock "cinder-8bd59d21-9f2c-440e-8ca2-b6bdef608f34-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:50:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] Acquiring lock "cinder-quobyte-8bd59d21-9f2c-440e-8ca2-b6bdef608f34" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:50:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] Lock "cinder-quobyte-8bd59d21-9f2c-440e-8ca2-b6bdef608f34" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:50:44 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb15324-54c9-4019-94af-47921f591678]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:44 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34 Jul 06 20:50:44 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:44 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb" returned: 0 in 0.675s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:50:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dacacc5-c86b-4132-814c-6ad35320963c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa15552d-df7b-46ae-8acc-5579baf5899d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:44 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Volume volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb (8bdf16b9-badc-4c59-a05b-a2743f4c34bb): created successfully Jul 06 20:50:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa15552d-df7b-46ae-8acc-5579baf5899d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Flow 'volume_create_manager' (d21e2645-7472-4fbb-9c05-a02adc854d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:50:44 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-318a70b7-5371-4061-b20c-f15e05385a74 tempest-GroupSnapshotsV319Test-348611754 None] Created volume successfully. Jul 06 20:50:44 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34" returned: 0 in 0.819s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:44 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34 Jul 06 20:50:44 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:45 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] GroupSnapshot 4b461e46-7ffe-4458-8cf9-7d775414aead: creating. Jul 06 20:50:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] Group snapshot 4b461e46-7ffe-4458-8cf9-7d775414aead: creating. {{(pid=87207) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 20:50:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] Creating offline snapshot dbad7093-c163-4c12-9e62-77e173a37277 of volume 8bdf16b9-badc-4c59-a05b-a2743f4c34bb {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:50:45 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[502797a7-8c15-4037-8a5a-f112539006af]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:45 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb Jul 06 20:50:45 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:45 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bd59d21-9f2c-440e-8ca2-b6bdef608f34" returned: 0 in 0.668s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] Lock "cinder-quobyte-8bd59d21-9f2c-440e-8ca2-b6bdef608f34" released by "delete_volume" :: held 1.530s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:50:45 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] Created reservations ['ce864400-0fd1-46ba-9365-238d29c38d71', '34ac355d-2bb0-4ef9-b9f4-76cf44eb3791', 'c1eb4816-fb9f-4525-86a3-23bf8587f5f1', '10b8e891-aaef-47f8-9562-4ea74b8a18c3'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:50:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:50:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:50:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:45 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:50:45 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:46 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb" returned: 0 in 0.826s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:46 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] Acquiring lock "cinder-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:50:46 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277 1G Jul 06 20:50:46 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:46 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] Lock "cinder-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:50:46 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] Acquiring lock "cinder-quobyte-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:50:46 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] Lock "cinder-quobyte-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf" acquired by "delete_volume" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:50:46 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.705s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:46 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:50:46 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] Deleted volume successfully. Jul 06 20:50:46 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b07c6b0-d5cc-42ec-b11f-6a64f45f415d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:46 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f3ada09b-8362-4584-a222-edb95e5271ca tempest-VolumesCloneTest-53377576 None] Lock "cinder-8bd59d21-9f2c-440e-8ca2-b6bdef608f34-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:50:46 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf Jul 06 20:50:46 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:47 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277 1G" returned: 0 in 0.861s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:47 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277 Jul 06 20:50:47 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:47 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf" returned: 0 in 0.788s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:47 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf Jul 06 20:50:47 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:47 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277" returned: 0 in 0.761s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:47 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 20:50:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:47 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf" returned: 0 in 0.672s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:47 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277 Jul 06 20:50:47 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:47 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] Lock "cinder-quobyte-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf" released by "delete_volume" :: held 1.549s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:50:48 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] Created reservations ['c78f02bc-df6a-4617-a4d8-1a9102583bb7', 'a777cb33-7f46-41f3-b295-60ed47aa1efd', 'f929f7e2-a1b7-4ac7-b2cb-0ef676cba241', '5b166340-a5f8-48af-ae58-b6cb193018ca'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:50:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:50:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:50:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:48 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:50:48 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:48 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277" returned: 0 in 0.736s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:48 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.info Jul 06 20:50:48 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:48 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.747s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:48 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:50:48 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] Deleted volume successfully. Jul 06 20:50:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2248da61-8284-4c87-a295-30a146f421cc tempest-VolumesCloneTest-53377576 None] Lock "cinder-fda8ff1a-b43d-4ef7-8b9e-a1cb73bb3dcf-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:50:49 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.info" returned: 0 in 0.898s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:49 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 20:50:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:49 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.info Jul 06 20:50:49 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:50 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.info" returned: 0 in 0.804s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.990s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:50 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-1a5bd790-ffe9-4827-a82b-a13d2d8c5d19 tempest-GroupSnapshotsV319Test-348611754 None] group_snapshot 4b461e46-7ffe-4458-8cf9-7d775414aead: created successfully Jul 06 20:50:51 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] group_snapshot 4b461e46-7ffe-4458-8cf9-7d775414aead: deleting Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] group_snapshot 4b461e46-7ffe-4458-8cf9-7d775414aead: deleting {{(pid=87207) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] Acquiring lock "cinder-quobyte-8bdf16b9-badc-4c59-a05b-a2743f4c34bb" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] Lock "cinder-quobyte-8bdf16b9-badc-4c59-a05b-a2743f4c34bb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] Acquiring lock "cinder-quobyte-dbad7093-c163-4c12-9e62-77e173a37277" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] Lock "cinder-quobyte-dbad7093-c163-4c12-9e62-77e173a37277" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] Deleting offline snapshot dbad7093-c163-4c12-9e62-77e173a37277 of volume 8bdf16b9-badc-4c59-a05b-a2743f4c34bb {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] snapshot_file for this snap is: volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcc1df2-b6a0-4ab4-b21c-f0d7f592d0a9]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Flow 'volume_create_manager' (ddae3893-6aa2-4968-9ba4-43684dbfa635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4424259b-a0de-4636-97d8-db86446c09ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4424259b-a0de-4636-97d8-db86446c09ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1018929102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b50bf9c-34df-42ac-86a2-0be20daa0141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a806883121a4fc1becc3bdeea4421bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:51Z,use_quota=True,user_id='ffc87e98130d46ada08885257d671248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec52574-3cd2-4c06-9190-257a38d7a52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec52574-3cd2-4c06-9190-257a38d7a52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d685d8-1b6d-405a-a061-b4efc77ddee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d685d8-1b6d-405a-a061-b4efc77ddee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b50bf9c-34df-42ac-86a2-0be20daa0141', 'volume_name': 'volume-8b50bf9c-34df-42ac-86a2-0be20daa0141', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5cb714-9d22-4196-a074-9b407a355b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5cb714-9d22-4196-a074-9b407a355b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:51 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277 Jul 06 20:50:51 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560ea96b-c7d3-4d64-a38b-bc5df849403a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:51 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Volume 8b50bf9c-34df-42ac-86a2-0be20daa0141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b50bf9c-34df-42ac-86a2-0be20daa0141', 'volume_size': 1} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1018929102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b50bf9c-34df-42ac-86a2-0be20daa0141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a806883121a4fc1becc3bdeea4421bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:51Z,use_quota=True,user_id='ffc87e98130d46ada08885257d671248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Creating volume 8b50bf9c-34df-42ac-86a2-0be20daa0141 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:50:51 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:50:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b50bf9c-34df-42ac-86a2-0be20daa0141 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:51 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b50bf9c-34df-42ac-86a2-0be20daa0141 1073741824 Jul 06 20:50:51 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:52 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277" returned: 0 in 0.903s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:50:52 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[763bfa72-4f41-4857-b5c1-f729be8587bc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:52 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb Jul 06 20:50:52 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:52 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b50bf9c-34df-42ac-86a2-0be20daa0141 1073741824" returned: 0 in 0.927s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b50bf9c-34df-42ac-86a2-0be20daa0141 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:52 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b50bf9c-34df-42ac-86a2-0be20daa0141 Jul 06 20:50:52 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:52 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:50:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Flow 'volume_create_manager' (7e900a82-1ca8-44bb-b2de-f38e86d72cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:50:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671ab007-e4d5-417f-94f4-eeac6b456410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671ab007-e4d5-417f-94f4-eeac6b456410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-11072379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69359b5-a535-4ca4-8bae-3ec53d9c48c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16db5fcc4f18400e9cef0b19f0360b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:53Z,use_quota=True,user_id='041fa46e53544cfbb9049b0fa6c1c970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a310de-5fac-4048-acda-5b3c45841d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a310de-5fac-4048-acda-5b3c45841d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a89849-6d5c-4d8d-9977-c109d746a9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:52 devstack cinder-volume[87207]: DEBUG cinder.image.glance [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Creating Keystone auth plugin from conf {{(pid=87207) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 20:50:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a89849-6d5c-4d8d-9977-c109d746a9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f69359b5-a535-4ca4-8bae-3ec53d9c48c6', 'volume_name': 'volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6', 'volume_size': 1, 'image_id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6600b41119584a67ac9b8504a63b23ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc1ffc72-45ae-44be-a63c-7222cd51bab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc1ffc72-45ae-44be-a63c-7222cd51bab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1a6e5d-0ea0-45d8-8751-3e42989a4b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:53 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Volume f69359b5-a535-4ca4-8bae-3ec53d9c48c6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6', 'volume_size': 1, 'image_id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6600b41119584a67ac9b8504a63b23ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 20:50:53 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Trying to clone f69359b5-a535-4ca4-8bae-3ec53d9c48c6 from image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d at location (None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}]). {{(pid=87207) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 20:50:53 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb" returned: 0 in 0.880s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:53 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b50bf9c-34df-42ac-86a2-0be20daa0141" returned: 0 in 0.681s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:50:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:53 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277 Jul 06 20:50:53 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560ea96b-c7d3-4d64-a38b-bc5df849403a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b50bf9c-34df-42ac-86a2-0be20daa0141', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484fe265-5066-425f-bb1d-30f2bf766cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:50:53 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Volume volume-8b50bf9c-34df-42ac-86a2-0be20daa0141 (8b50bf9c-34df-42ac-86a2-0be20daa0141): created successfully Jul 06 20:50:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484fe265-5066-425f-bb1d-30f2bf766cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:50:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Flow 'volume_create_manager' (ddae3893-6aa2-4968-9ba4-43684dbfa635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:50:53 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d371658a-3b68-4709-a1fb-813061f70b1d tempest-AttachVolumeNegativeTest-2089758529 None] Created volume successfully. Jul 06 20:50:53 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_fmak5lnrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 20:50:53 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Image download 20.69 MB at 20.69 MB/s Jul 06 20:50:53 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4619cfdd-94ad-4697-9999-a438777457b7]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_fmak5lnrdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:53 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_fmak5lnrdevstack@QuobyteHD Jul 06 20:50:53 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:54 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277" returned: 0 in 0.776s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:54 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277 Jul 06 20:50:54 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:54 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_fmak5lnrdevstack@QuobyteHD" returned: 0 in 0.782s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:54 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Temporary image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d is fetched for user 041fa46e53544cfbb9049b0fa6c1c970. {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 20:50:54 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b0cc91-e15f-4b0f-ba45-727182bdba9e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_fmak5lnrdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:54 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_fmak5lnrdevstack@QuobyteHD Jul 06 20:50:54 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:54 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb.dbad7093-c163-4c12-9e62-77e173a37277" returned: 0 in 0.675s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] Lock "cinder-quobyte-dbad7093-c163-4c12-9e62-77e173a37277" released by "_delete_snapshot" :: held 3.360s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:50:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] Lock "cinder-quobyte-8bdf16b9-badc-4c59-a05b-a2743f4c34bb" released by "delete_snapshot" :: held 3.382s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:50:54 devstack cinder-volume[87207]: WARNING cinder.quota [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1567973506 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1567973506, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:50:54 devstack cinder-volume[87207]: WARNING cinder.quota [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1567973506 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1567973506, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:50:54 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] Created reservations ['d5234650-a4bc-4c26-879d-08824638d607', '9d48b05c-7700-4f06-b73a-eb34bfe38500', '1fdba331-5c82-46dd-abf4-14a0472f8357', 'c93ea6df-209a-45cf-b061-fe2809d9aea6'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:50:54 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d2707b4e-16a6-4586-9cf6-e3781039ff6b tempest-GroupSnapshotsV319Test-348611754 None] group_snapshot 4b461e46-7ffe-4458-8cf9-7d775414aead: deleted successfully Jul 06 20:50:55 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_fmak5lnrdevstack@QuobyteHD" returned: 0 in 0.745s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-11072379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69359b5-a535-4ca4-8bae-3ec53d9c48c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16db5fcc4f18400e9cef0b19f0360b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:53Z,use_quota=True,user_id='041fa46e53544cfbb9049b0fa6c1c970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:50:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Creating volume f69359b5-a535-4ca4-8bae-3ec53d9c48c6 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:50:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:50:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:50:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:50:55 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:50:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:55 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 1073741824 Jul 06 20:50:55 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:55 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 1073741824" returned: 0 in 0.885s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:56 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 Jul 06 20:50:56 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] Acquiring lock "cinder-quobyte-8bdf16b9-badc-4c59-a05b-a2743f4c34bb" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:50:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] Lock "cinder-quobyte-8bdf16b9-badc-4c59-a05b-a2743f4c34bb" acquired by "delete_volume" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:50:56 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdf17f4-a938-418d-84bb-da0675d5ca71]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:56 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb Jul 06 20:50:56 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:56 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6" returned: 0 in 0.686s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:50:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:56 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Attempting download of 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d ((None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}])) to volume f69359b5-a535-4ca4-8bae-3ec53d9c48c6. {{(pid=87207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 20:50:56 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30e9913-2cd3-4b71-bf6a-32f29817e2b9]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d__0mfa0xu {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-8de3b3d8-72e4-4fdc-adfb-4f4138e3f01d req-73b040e9-77c6-4a94-9eb0-01c482615a84 tempest-AttachVolumeNegativeTest-2089758529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-8de3b3d8-72e4-4fdc-adfb-4f4138e3f01d req-73b040e9-77c6-4a94-9eb0-01c482615a84 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:56 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[57048e28-f2ea-43c4-b082-8e2951decb9c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-8de3b3d8-72e4-4fdc-adfb-4f4138e3f01d req-73b040e9-77c6-4a94-9eb0-01c482615a84 tempest-AttachVolumeNegativeTest-2089758529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b50bf9c-34df-42ac-86a2-0be20daa0141 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:56 devstack sudo[94541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d__0mfa0xu Jul 06 20:50:56 devstack sudo[94541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:57 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b50bf9c-34df-42ac-86a2-0be20daa0141 Jul 06 20:50:57 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:57 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb" returned: 0 in 0.849s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:57 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb Jul 06 20:50:57 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:57 devstack sudo[94541]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d__0mfa0xu" returned: 0 in 0.786s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d__0mfa0xu {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:57 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d__0mfa0xu Jul 06 20:50:57 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:57 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-8de3b3d8-72e4-4fdc-adfb-4f4138e3f01d req-73b040e9-77c6-4a94-9eb0-01c482615a84 tempest-AttachVolumeNegativeTest-2089758529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b50bf9c-34df-42ac-86a2-0be20daa0141" returned: 0 in 0.828s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-8de3b3d8-72e4-4fdc-adfb-4f4138e3f01d req-73b040e9-77c6-4a94-9eb0-01c482615a84 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.847s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-8de3b3d8-72e4-4fdc-adfb-4f4138e3f01d req-73b040e9-77c6-4a94-9eb0-01c482615a84 tempest-AttachVolumeNegativeTest-2089758529 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-8b50bf9c-34df-42ac-86a2-0be20daa0141', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c31975b-d940-4a2d-87cf-136aac711f1a', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 20:50:57 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8bdf16b9-badc-4c59-a05b-a2743f4c34bb" returned: 0 in 0.696s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] Lock "cinder-quobyte-8bdf16b9-badc-4c59-a05b-a2743f4c34bb" released by "delete_volume" :: held 1.630s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:50:57 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-8de3b3d8-72e4-4fdc-adfb-4f4138e3f01d req-73b040e9-77c6-4a94-9eb0-01c482615a84 tempest-AttachVolumeNegativeTest-2089758529 None] attachment_update completed successfully. Jul 06 20:50:57 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] Created reservations ['d6509789-f2fe-4621-a848-c4d860d6ca37'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:50:57 devstack cinder-volume[87207]: WARNING cinder.quota [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1567973506 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1567973506, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:50:57 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] Created reservations ['5b06ab27-cd88-41d8-b678-2e1a07f0fff5', '05ca60ec-427b-4c6f-8e85-32483c282cae', '345f0688-e51c-491e-9f84-c345759c53dd', 'c35648f9-2ed9-4378-a169-c6d191030705'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:50:57 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:50:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:50:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:50:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:58 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:50:58 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:50:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:50:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:50:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:50:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:50:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:58 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:50:58 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:58 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d__0mfa0xu" returned: 1 in 0.776s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d__0mfa0xu' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:50:58 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7e113c-edd4-4e34-a64a-c772e1433b5b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:50:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_fmak5lnrdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:58 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_fmak5lnrdevstack@QuobyteHD Jul 06 20:50:58 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:50:58 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.858s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:50:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:50:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:50:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:50:58 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.786s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:50:58 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0efd943a-1042-4772-b707-37db983abde4 tempest-GroupSnapshotsV319Test-348611754 None] Delete group completed successfully. Jul 06 20:50:59 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Jul 06 20:50:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_fmak5lnrdevstack@QuobyteHD" returned: 0 in 0.868s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:50:59 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d was qcow2, converting to raw {{(pid=87207) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 20:50:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_fmak5lnrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:50:59 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_fmak5lnrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 Jul 06 20:50:59 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:01 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_fmak5lnrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6" returned: 0 in 2.187s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:01 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_fmak5lnrdevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 20:51:01 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Converted 112.00 MB image at 51.19 MB/s Jul 06 20:51:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:01 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 1G Jul 06 20:51:01 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:02 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 1G" returned: 0 in 0.788s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:02 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2939f37-d251-454a-b66e-54611b986f14]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:51:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:02 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 Jul 06 20:51:02 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:03 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6" returned: 0 in 0.870s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:03 devstack sudo[94603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 Jul 06 20:51:03 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:03 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-2cb56921-21e1-4d3a-8d65-e70eb45876b0 req-844440a4-8093-407a-a225-53ee2f87f654 tempest-AttachVolumeNegativeTest-2089758529 None] Terminate volume connection completed successfully. Jul 06 20:51:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-2cb56921-21e1-4d3a-8d65-e70eb45876b0 req-844440a4-8093-407a-a225-53ee2f87f654 tempest-AttachVolumeNegativeTest-2089758529 None] Deleting attachment 1c31975b-d940-4a2d-87cf-136aac711f1a. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 20:51:03 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6" returned: 1 in 0.842s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:51:03 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Downloaded image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d ((None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}])) to volume f69359b5-a535-4ca4-8bae-3ec53d9c48c6 successfully. {{(pid=87207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 20:51:03 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Temporary image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d for user 041fa46e53544cfbb9049b0fa6c1c970 is deleted. {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 20:51:03 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Marking volume f69359b5-a535-4ca4-8bae-3ec53d9c48c6 as bootable. {{(pid=87207) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 20:51:03 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Copying metadata from image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d to f69359b5-a535-4ca4-8bae-3ec53d9c48c6. {{(pid=87207) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 20:51:03 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Creating volume glance metadata for volume f69359b5-a535-4ca4-8bae-3ec53d9c48c6 backed by image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87207) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 20:51:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1a6e5d-0ea0-45d8-8751-3e42989a4b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6', 'volume_size': 1, 'image_id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6600b41119584a67ac9b8504a63b23ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d6e841-dde0-41d5-887e-d06d106e2e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:04 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Volume volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 (f69359b5-a535-4ca4-8bae-3ec53d9c48c6): created successfully Jul 06 20:51:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d6e841-dde0-41d5-887e-d06d106e2e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Flow 'volume_create_manager' (7e900a82-1ca8-44bb-b2de-f38e86d72cde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:51:04 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-1665e4ce-fc26-489c-a204-02eb04715913 tempest-VolumesExtendTest-1125181071 None] Created volume successfully. Jul 06 20:51:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2f4bfb6f-03f9-4fbe-9062-2515f35256fd tempest-VolumesExtendTest-1125181071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:51:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2f4bfb6f-03f9-4fbe-9062-2515f35256fd tempest-VolumesExtendTest-1125181071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:51:04 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5a21d1-724a-468c-8834-b0c7a68a2466]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:51:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2f4bfb6f-03f9-4fbe-9062-2515f35256fd tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:04 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 Jul 06 20:51:04 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:05 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2f4bfb6f-03f9-4fbe-9062-2515f35256fd tempest-VolumesExtendTest-1125181071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6" returned: 0 in 0.832s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2f4bfb6f-03f9-4fbe-9062-2515f35256fd tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:05 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 Jul 06 20:51:05 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:06 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-cee10eee-5856-4606-bc56-7709db9ac5a1 req-c3adc515-d3dd-45f4-baa9-a7c66529d00b tempest-AttachVolumeTestJSON-635946371 None] Terminate volume connection completed successfully. Jul 06 20:51:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-cee10eee-5856-4606-bc56-7709db9ac5a1 req-c3adc515-d3dd-45f4-baa9-a7c66529d00b tempest-AttachVolumeTestJSON-635946371 None] Deleting attachment 766ccc09-1b90-4dcc-9777-0332a4ad7f3d. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 20:51:06 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2f4bfb6f-03f9-4fbe-9062-2515f35256fd tempest-VolumesExtendTest-1125181071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6" returned: 1 in 1.001s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2f4bfb6f-03f9-4fbe-9062-2515f35256fd tempest-VolumesExtendTest-1125181071 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:51:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2f4bfb6f-03f9-4fbe-9062-2515f35256fd tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 2G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2f4bfb6f-03f9-4fbe-9062-2515f35256fd tempest-VolumesExtendTest-1125181071 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 2G" returned: 0 in 0.082s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2f4bfb6f-03f9-4fbe-9062-2515f35256fd tempest-VolumesExtendTest-1125181071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.970s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:51:06 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-2f4bfb6f-03f9-4fbe-9062-2515f35256fd tempest-VolumesExtendTest-1125181071 None] Extend volume completed successfully. Jul 06 20:51:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] Acquiring lock "cinder-f69359b5-a535-4ca4-8bae-3ec53d9c48c6-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:51:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] Lock "cinder-f69359b5-a535-4ca4-8bae-3ec53d9c48c6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:51:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] Acquiring lock "cinder-quobyte-f69359b5-a535-4ca4-8bae-3ec53d9c48c6" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:51:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] Lock "cinder-quobyte-f69359b5-a535-4ca4-8bae-3ec53d9c48c6" acquired by "delete_volume" :: waited 0.024s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:51:07 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8022e9-1627-4cf3-bf7a-306bccf82ad8]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:51:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:07 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 Jul 06 20:51:07 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:08 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6" returned: 0 in 1.079s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:08 devstack sudo[94660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 Jul 06 20:51:08 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:09 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6" returned: 1 in 1.001s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:51:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:09 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6 Jul 06 20:51:09 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:10 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f69359b5-a535-4ca4-8bae-3ec53d9c48c6" returned: 0 in 0.859s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] Lock "cinder-quobyte-f69359b5-a535-4ca4-8bae-3ec53d9c48c6" released by "delete_volume" :: held 3.037s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:51:10 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] Created reservations ['0c360a04-9415-4cce-ba95-603dc6d7e45a', '82ca4c3f-f1c7-4078-a418-130fb76e5281', 'e1a71c1a-996b-44e5-9717-bdddfc18fa38', 'ae879338-ad70-41a1-b259-66c7ade40416'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:51:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:51:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:51:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:51:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:51:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:51:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:10 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:51:10 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:10 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-c671e280-f98e-4c2d-90e1-c04a477dfd18 tempest-GroupsV320Test-886849416 None] Group tempest-GroupsV320Test-Group-1160670579: creating Jul 06 20:51:10 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-c671e280-f98e-4c2d-90e1-c04a477dfd18 tempest-GroupsV320Test-886849416 None] Group tempest-GroupsV320Test-Group-1160670579: created successfully Jul 06 20:51:10 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-c671e280-f98e-4c2d-90e1-c04a477dfd18 tempest-GroupsV320Test-886849416 None] Create group completed successfully. Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Flow 'volume_create_manager' (86f948ee-4075-4784-815f-7284796bff30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bada3892-cc60-4b39-8ffc-72dccafc81f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bada3892-cc60-4b39-8ffc-72dccafc81f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1548073148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47a98c3-71da-44be-998e-9d0fc5041eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16db5fcc4f18400e9cef0b19f0360b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:11Z,use_quota=True,user_id='041fa46e53544cfbb9049b0fa6c1c970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f03d4d1-4a42-477d-b896-3fca7a8b492a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f03d4d1-4a42-477d-b896-3fca7a8b492a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe0d832-ceb2-4204-befd-ea719f2bc0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe0d832-ceb2-4204-befd-ea719f2bc0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd47a98c3-71da-44be-998e-9d0fc5041eb3', 'volume_name': 'volume-d47a98c3-71da-44be-998e-9d0fc5041eb3', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7509cd58-6695-4a3e-a0aa-3bb6660ed7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7509cd58-6695-4a3e-a0aa-3bb6660ed7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa8c16c-c3d6-4ab8-9932-cb986b918383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:11 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Volume d47a98c3-71da-44be-998e-9d0fc5041eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d47a98c3-71da-44be-998e-9d0fc5041eb3', 'volume_size': 1} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1548073148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47a98c3-71da-44be-998e-9d0fc5041eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16db5fcc4f18400e9cef0b19f0360b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:11Z,use_quota=True,user_id='041fa46e53544cfbb9049b0fa6c1c970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Creating volume d47a98c3-71da-44be-998e-9d0fc5041eb3 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:51:11 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:11 devstack sudo[94679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 1073741824 Jul 06 20:51:11 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:11 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.759s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:51:11 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] Deleted volume successfully. Jul 06 20:51:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-81993801-3e37-4bd1-b5f5-9ff822b43e9f tempest-VolumesExtendTest-1125181071 None] Lock "cinder-f69359b5-a535-4ca4-8bae-3ec53d9c48c6-delete_volume" released by "delete_volume" :: held 4.070s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:51:12 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 1073741824" returned: 0 in 0.952s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:12 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 Jul 06 20:51:12 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:12 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-a4730555-984c-43e1-9b0d-6a5c6360e71e tempest-GroupsV320Test-886849416 None] Created reservations ['da03d54c-b1aa-4689-ba4a-9a7356df0d98'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:51:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a4730555-984c-43e1-9b0d-6a5c6360e71e tempest-GroupsV320Test-886849416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:51:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a4730555-984c-43e1-9b0d-6a5c6360e71e tempest-GroupsV320Test-886849416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:51:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a4730555-984c-43e1-9b0d-6a5c6360e71e tempest-GroupsV320Test-886849416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:51:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a4730555-984c-43e1-9b0d-6a5c6360e71e tempest-GroupsV320Test-886849416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:51:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a4730555-984c-43e1-9b0d-6a5c6360e71e tempest-GroupsV320Test-886849416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:51:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a4730555-984c-43e1-9b0d-6a5c6360e71e tempest-GroupsV320Test-886849416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:12 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:51:12 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:13 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3" returned: 0 in 0.996s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:51:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.024s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:51:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa8c16c-c3d6-4ab8-9932-cb986b918383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d47a98c3-71da-44be-998e-9d0fc5041eb3', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18531807-6ba9-4bee-ab93-46dfb48ddb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:13 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Volume volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 (d47a98c3-71da-44be-998e-9d0fc5041eb3): created successfully Jul 06 20:51:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18531807-6ba9-4bee-ab93-46dfb48ddb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Flow 'volume_create_manager' (86f948ee-4075-4784-815f-7284796bff30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:51:13 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-505caa01-c922-48a5-90bf-900fbe80687b tempest-VolumesExtendTest-1125181071 None] Created volume successfully. Jul 06 20:51:13 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a4730555-984c-43e1-9b0d-6a5c6360e71e tempest-GroupsV320Test-886849416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.828s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:13 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-a4730555-984c-43e1-9b0d-6a5c6360e71e tempest-GroupsV320Test-886849416 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:51:13 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-a4730555-984c-43e1-9b0d-6a5c6360e71e tempest-GroupsV320Test-886849416 None] Delete group completed successfully. Jul 06 20:51:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:51:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:51:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] Creating offline snapshot bd365b47-d260-4bbb-b681-65495d2396da of volume d47a98c3-71da-44be-998e-9d0fc5041eb3 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:51:14 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0d0aa2-b147-4242-a003-4f998cc39604]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:51:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:14 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 Jul 06 20:51:14 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:15 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3" returned: 0 in 1.128s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:15 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da 1G Jul 06 20:51:15 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:16 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da 1G" returned: 0 in 1.011s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:16 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da Jul 06 20:51:16 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:17 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da" returned: 0 in 0.821s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:17 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da is being set with open permissions: ugo+rw Jul 06 20:51:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:17 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da Jul 06 20:51:17 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:18 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da" returned: 0 in 1.162s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:19 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.info Jul 06 20:51:19 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:20 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.info" returned: 0 in 1.042s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:20 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.info is being set with open permissions: ugo+rw Jul 06 20:51:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:20 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.info Jul 06 20:51:20 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:20 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.info" returned: 0 in 0.812s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.146s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:51:20 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0eaa98e9-e4cf-40ca-a69b-fc33aa3e6c46 tempest-VolumesExtendTest-1125181071 None] Create snapshot completed successfully Jul 06 20:51:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4ecc8638-3509-4919-94ab-d45d19df9f65 tempest-VolumesExtendTest-1125181071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:51:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4ecc8638-3509-4919-94ab-d45d19df9f65 tempest-VolumesExtendTest-1125181071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:51:21 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfc4445-9675-4073-aa5e-26a91ea57ea6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:51:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4ecc8638-3509-4919-94ab-d45d19df9f65 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:21 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 Jul 06 20:51:21 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:22 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4ecc8638-3509-4919-94ab-d45d19df9f65 tempest-VolumesExtendTest-1125181071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3" returned: 0 in 0.983s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4ecc8638-3509-4919-94ab-d45d19df9f65 tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da 2G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4ecc8638-3509-4919-94ab-d45d19df9f65 tempest-VolumesExtendTest-1125181071 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da 2G" returned: 0 in 0.240s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4ecc8638-3509-4919-94ab-d45d19df9f65 tempest-VolumesExtendTest-1125181071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.313s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:51:22 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-4ecc8638-3509-4919-94ab-d45d19df9f65 tempest-VolumesExtendTest-1125181071 None] Extend volume completed successfully. Jul 06 20:51:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] Acquiring lock "cinder-bd365b47-d260-4bbb-b681-65495d2396da-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:51:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] Lock "cinder-bd365b47-d260-4bbb-b681-65495d2396da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:51:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] Acquiring lock "cinder-quobyte-d47a98c3-71da-44be-998e-9d0fc5041eb3" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:51:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] Lock "cinder-quobyte-d47a98c3-71da-44be-998e-9d0fc5041eb3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:51:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] Acquiring lock "cinder-quobyte-bd365b47-d260-4bbb-b681-65495d2396da" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:51:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] Lock "cinder-quobyte-bd365b47-d260-4bbb-b681-65495d2396da" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:51:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] Deleting offline snapshot bd365b47-d260-4bbb-b681-65495d2396da of volume d47a98c3-71da-44be-998e-9d0fc5041eb3 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:51:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] snapshot_file for this snap is: volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:51:23 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4bd13a-a6b8-4d0e-8a2e-a0e031c98361]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:51:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:23 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da Jul 06 20:51:23 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:24 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da" returned: 0 in 1.159s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d47a98c3-71da-44be-998e-9d0fc5041eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:51:25 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[36712343-5df2-4ccb-93c5-8a10fd9f5f7d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:51:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:25 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 Jul 06 20:51:25 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:26 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3" returned: 0 in 1.443s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:26 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da Jul 06 20:51:26 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:27 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da" returned: 0 in 1.229s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:27 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da Jul 06 20:51:27 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:28 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3.bd365b47-d260-4bbb-b681-65495d2396da" returned: 0 in 0.976s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:28 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] Lock "cinder-quobyte-bd365b47-d260-4bbb-b681-65495d2396da" released by "_delete_snapshot" :: held 4.948s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:51:28 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] Lock "cinder-quobyte-d47a98c3-71da-44be-998e-9d0fc5041eb3" released by "delete_snapshot" :: held 4.980s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:51:28 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] Created reservations ['1d61c5bb-02e9-469e-8433-6dbf5008b4b5', 'bf5e8c41-fabf-4bd5-9eb5-da62980f4dc9', '7597a493-d0c3-4416-9005-1219637a6add', '7a16cf5a-038c-4205-a6c0-a8dab9b2bd96'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:51:28 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] Delete snapshot completed successfully. Jul 06 20:51:28 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-19031799-e6fa-44ce-84c7-a2dbb44c000e tempest-VolumesExtendTest-1125181071 None] Lock "cinder-bd365b47-d260-4bbb-b681-65495d2396da-delete_snapshot" released by "delete_snapshot" :: held 5.159s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:51:29 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] Acquiring lock "cinder-d47a98c3-71da-44be-998e-9d0fc5041eb3-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:51:29 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] Lock "cinder-d47a98c3-71da-44be-998e-9d0fc5041eb3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:51:29 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] Acquiring lock "cinder-quobyte-d47a98c3-71da-44be-998e-9d0fc5041eb3" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:51:29 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] Lock "cinder-quobyte-d47a98c3-71da-44be-998e-9d0fc5041eb3" acquired by "delete_volume" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:51:29 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c3ecfb-ee28-49c9-b5c9-1d26d5014fd4]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:51:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:29 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 Jul 06 20:51:29 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:30 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3" returned: 0 in 0.912s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:30 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3 Jul 06 20:51:30 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:31 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d47a98c3-71da-44be-998e-9d0fc5041eb3" returned: 0 in 0.843s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:31 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] Lock "cinder-quobyte-d47a98c3-71da-44be-998e-9d0fc5041eb3" released by "delete_volume" :: held 1.830s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:51:31 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] Created reservations ['6bd345f2-f122-4c22-99e1-36a44df87505', 'a111a629-23ee-44d9-89c2-b5c1619dab89', '86ad5614-2ff5-4a34-a7a7-77421776e7f0', '9eb43789-0af3-448c-911b-a5dbf31bb414'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:51:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:51:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:51:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:51:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:51:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:51:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:31 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:51:31 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:32 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.552s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:33 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:51:33 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] Deleted volume successfully. Jul 06 20:51:33 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=90,cinder:UPDATE=91,cinder:DELETE=5,cinder:INSERT=19 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:51:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c3926a9a-0200-4cc6-8c72-24631649636c tempest-VolumesExtendTest-1125181071 None] Lock "cinder-d47a98c3-71da-44be-998e-9d0fc5041eb3-delete_volume" released by "delete_volume" :: held 3.800s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:51:41 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:UPDATE=82,cinder:SELECT=81,cinder:INSERT=31,cinder:DELETE=5 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Flow 'volume_create_manager' (d06340e6-ece5-41aa-8714-6a19b2e1f3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ec45e6-2d98-4738-bfef-31562365a4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ec45e6-2d98-4738-bfef-31562365a4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-170274806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a2d562-9528-4d16-9a25-7b89ad104eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b05a694039ea4097b2dfbc2b41c3f38b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:47Z,use_quota=True,user_id='df9515ed50a8458e978fcdbfa5102760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08be2194-c227-4714-b332-c4531a3389dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08be2194-c227-4714-b332-c4531a3389dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ffe5be-da75-4bcc-a8a9-266fafe2ef3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ffe5be-da75-4bcc-a8a9-266fafe2ef3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99a2d562-9528-4d16-9a25-7b89ad104eb1', 'volume_name': 'volume-99a2d562-9528-4d16-9a25-7b89ad104eb1', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ea8c50-7b23-47ff-9102-8fcf2333709f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ea8c50-7b23-47ff-9102-8fcf2333709f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413047ee-6b9c-4098-8995-03472f9a35c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:47 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Volume 99a2d562-9528-4d16-9a25-7b89ad104eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99a2d562-9528-4d16-9a25-7b89ad104eb1', 'volume_size': 1} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-170274806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a2d562-9528-4d16-9a25-7b89ad104eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b05a694039ea4097b2dfbc2b41c3f38b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:47Z,use_quota=True,user_id='df9515ed50a8458e978fcdbfa5102760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Creating volume 99a2d562-9528-4d16-9a25-7b89ad104eb1 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:51:47 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:51:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99a2d562-9528-4d16-9a25-7b89ad104eb1 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:47 devstack sudo[95050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99a2d562-9528-4d16-9a25-7b89ad104eb1 1073741824 Jul 06 20:51:47 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:48 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99a2d562-9528-4d16-9a25-7b89ad104eb1 1073741824" returned: 0 in 0.986s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99a2d562-9528-4d16-9a25-7b89ad104eb1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:48 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99a2d562-9528-4d16-9a25-7b89ad104eb1 Jul 06 20:51:48 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:49 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99a2d562-9528-4d16-9a25-7b89ad104eb1" returned: 0 in 0.840s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:51:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:51:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413047ee-6b9c-4098-8995-03472f9a35c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99a2d562-9528-4d16-9a25-7b89ad104eb1', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3282cd-8bbb-4bdc-84ed-362ecb9dd3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:49 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Volume volume-99a2d562-9528-4d16-9a25-7b89ad104eb1 (99a2d562-9528-4d16-9a25-7b89ad104eb1): created successfully Jul 06 20:51:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3282cd-8bbb-4bdc-84ed-362ecb9dd3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Flow 'volume_create_manager' (d06340e6-ece5-41aa-8714-6a19b2e1f3e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:51:49 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-08c19e65-32e7-4850-8d52-fe80110a65eb tempest-VolumesListAdminTestJSON-181466438 None] Created volume successfully. Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Flow 'volume_create_manager' (45584877-778d-4480-ade8-3b999645a842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ced08f-739a-40a6-8804-4a6f7370ddff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ced08f-739a-40a6-8804-4a6f7370ddff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1518188176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bde74b5-4143-4a86-8ea1-6b8dea8fd81b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b05a694039ea4097b2dfbc2b41c3f38b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:51Z,use_quota=True,user_id='df9515ed50a8458e978fcdbfa5102760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5991f7-3373-4522-9218-32a5b5a33c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5991f7-3373-4522-9218-32a5b5a33c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae1f4bbd-3065-4c05-a8f5-85f829ad247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae1f4bbd-3065-4c05-a8f5-85f829ad247d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bde74b5-4143-4a86-8ea1-6b8dea8fd81b', 'volume_name': 'volume-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb68ae5d-bf5b-4333-9cc6-dd188eb2e7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb68ae5d-bf5b-4333-9cc6-dd188eb2e7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd64a52b-3a44-4b7e-aaf1-51f7e85e4be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:51 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Volume 7bde74b5-4143-4a86-8ea1-6b8dea8fd81b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b', 'volume_size': 1} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1518188176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bde74b5-4143-4a86-8ea1-6b8dea8fd81b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b05a694039ea4097b2dfbc2b41c3f38b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:51Z,use_quota=True,user_id='df9515ed50a8458e978fcdbfa5102760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Creating volume 7bde74b5-4143-4a86-8ea1-6b8dea8fd81b {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:51:51 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:51:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:51 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b 1073741824 Jul 06 20:51:51 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:52 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b 1073741824" returned: 0 in 1.030s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:52 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b Jul 06 20:51:52 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:53 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b" returned: 0 in 0.806s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:51:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:51:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd64a52b-3a44-4b7e-aaf1-51f7e85e4be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (373bf07d-ba75-4aec-aced-f616112094d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:53 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Volume volume-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b (7bde74b5-4143-4a86-8ea1-6b8dea8fd81b): created successfully Jul 06 20:51:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (373bf07d-ba75-4aec-aced-f616112094d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Flow 'volume_create_manager' (45584877-778d-4480-ade8-3b999645a842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:51:53 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-15b95bc9-61d0-4768-a82c-7587ac5bd925 tempest-VolumesListAdminTestJSON-181466438 None] Created volume successfully. Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Flow 'volume_create_manager' (873ea324-2d2e-43be-a330-a78fce54bdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4071ba-3069-4a13-9563-661f028b7997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4071ba-3069-4a13-9563-661f028b7997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1849761878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b05a694039ea4097b2dfbc2b41c3f38b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:55Z,use_quota=True,user_id='df9515ed50a8458e978fcdbfa5102760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec0de2b-6ff9-4c4e-b659-51006186c294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec0de2b-6ff9-4c4e-b659-51006186c294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fd25a1-b813-4109-b064-227ccd20dbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fd25a1-b813-4109-b064-227ccd20dbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7', 'volume_name': 'volume-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5c7539-c326-47b2-bd6a-a2e2f4d63e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5c7539-c326-47b2-bd6a-a2e2f4d63e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db40993-2d7a-44ac-be4d-38002002c64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:55 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Volume 16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7', 'volume_size': 1} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1849761878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b05a694039ea4097b2dfbc2b41c3f38b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:55Z,use_quota=True,user_id='df9515ed50a8458e978fcdbfa5102760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Creating volume 16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:51:55 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:51:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:55 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7 1073741824 Jul 06 20:51:55 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:56 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7 1073741824" returned: 0 in 1.198s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:56 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7 Jul 06 20:51:56 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:57 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7" returned: 0 in 0.729s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] <== create_volume: return (1996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:51:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:51:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db40993-2d7a-44ac-be4d-38002002c64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6168852f-c0ed-44c4-952c-3a26ac0dc3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:57 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Volume volume-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7 (16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7): created successfully Jul 06 20:51:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6168852f-c0ed-44c4-952c-3a26ac0dc3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Flow 'volume_create_manager' (873ea324-2d2e-43be-a330-a78fce54bdca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:51:57 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-30443ac4-4a6f-4157-8e39-e3b3a91c85fb tempest-VolumesListAdminTestJSON-181466438 None] Created volume successfully. Jul 06 20:51:57 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:51:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:51:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:51:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:51:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:51:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:51:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:58 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:51:58 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Flow 'volume_create_manager' (2f466960-44a7-40a4-9c34-820a663f747b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189511c6-b17e-4367-ab01-47875793b1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189511c6-b17e-4367-ab01-47875793b1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1445959276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ef762c-954d-431b-bd8b-4159fcae7e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a806883121a4fc1becc3bdeea4421bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:59Z,use_quota=True,user_id='ffc87e98130d46ada08885257d671248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a858f5-c31c-4b15-ba05-9111e40ef09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a858f5-c31c-4b15-ba05-9111e40ef09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74aa6acb-679e-41eb-960a-44659cc871f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74aa6acb-679e-41eb-960a-44659cc871f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6ef762c-954d-431b-bd8b-4159fcae7e97', 'volume_name': 'volume-e6ef762c-954d-431b-bd8b-4159fcae7e97', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a9296f-e086-43ce-a108-a2eb7aa0a7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a9296f-e086-43ce-a108-a2eb7aa0a7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b6ff7f-72a1-4756-8d1a-ec8d01c93617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:58 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Volume e6ef762c-954d-431b-bd8b-4159fcae7e97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6ef762c-954d-431b-bd8b-4159fcae7e97', 'volume_size': 1} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1445959276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ef762c-954d-431b-bd8b-4159fcae7e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a806883121a4fc1becc3bdeea4421bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:59Z,use_quota=True,user_id='ffc87e98130d46ada08885257d671248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Creating volume e6ef762c-954d-431b-bd8b-4159fcae7e97 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:51:58 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:51:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6ef762c-954d-431b-bd8b-4159fcae7e97 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:51:59 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6ef762c-954d-431b-bd8b-4159fcae7e97 1073741824 Jul 06 20:51:59 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:51:59 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Jul 06 20:51:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.161s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:51:59 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:51:59 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:51:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:51:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:51:59 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:51:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Flow 'volume_create_manager' (b80ceb81-54db-4438-b027-1b75c32bfc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:51:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d9dd0f5-fd5a-4efa-ae4b-be3abce55ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d9dd0f5-fd5a-4efa-ae4b-be3abce55ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9014571-7886-4c07-99c6-c847a7ceab71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea2e0833454485c88184ecd43205839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:00Z,use_quota=True,user_id='ce077ff062864aa4b936ee906201266f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda9ec25-b4dc-441c-a935-93f957a651cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda9ec25-b4dc-441c-a935-93f957a651cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9f0fc1-674e-43da-939c-84793811455b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9f0fc1-674e-43da-939c-84793811455b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9014571-7886-4c07-99c6-c847a7ceab71', 'volume_name': 'volume-c9014571-7886-4c07-99c6-c847a7ceab71', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892b69d8-f06d-4e97-af6f-053328cb45f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892b69d8-f06d-4e97-af6f-053328cb45f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:51:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774c283d-e979-4d40-8f7a-1fbc5edc71c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:51:59 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Volume c9014571-7886-4c07-99c6-c847a7ceab71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9014571-7886-4c07-99c6-c847a7ceab71', 'volume_size': 1} Jul 06 20:51:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:00 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6ef762c-954d-431b-bd8b-4159fcae7e97 1073741824" returned: 0 in 1.095s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6ef762c-954d-431b-bd8b-4159fcae7e97 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:00 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6ef762c-954d-431b-bd8b-4159fcae7e97 Jul 06 20:52:00 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:00 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6ef762c-954d-431b-bd8b-4159fcae7e97" returned: 0 in 0.764s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9014571-7886-4c07-99c6-c847a7ceab71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea2e0833454485c88184ecd43205839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:00Z,use_quota=True,user_id='ce077ff062864aa4b936ee906201266f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Creating volume c9014571-7886-4c07-99c6-c847a7ceab71 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:52:00 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c9014571-7886-4c07-99c6-c847a7ceab71 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:00 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c9014571-7886-4c07-99c6-c847a7ceab71 1073741824 Jul 06 20:52:00 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b6ff7f-72a1-4756-8d1a-ec8d01c93617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6ef762c-954d-431b-bd8b-4159fcae7e97', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0314d3a-8afa-4060-88f2-fb192c61cb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:00 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Volume volume-e6ef762c-954d-431b-bd8b-4159fcae7e97 (e6ef762c-954d-431b-bd8b-4159fcae7e97): created successfully Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0314d3a-8afa-4060-88f2-fb192c61cb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:00 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Flow 'volume_create_manager' (2f466960-44a7-40a4-9c34-820a663f747b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:52:00 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-a3c4cd5c-a57b-4e42-93ad-a50b13ee0a52 tempest-AttachVolumeNegativeTest-2089758529 None] Created volume successfully. Jul 06 20:52:02 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c9014571-7886-4c07-99c6-c847a7ceab71 1073741824" returned: 0 in 1.306s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c9014571-7886-4c07-99c6-c847a7ceab71 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:02 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c9014571-7886-4c07-99c6-c847a7ceab71 Jul 06 20:52:02 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:03 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c9014571-7886-4c07-99c6-c847a7ceab71" returned: 0 in 0.866s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] <== create_volume: return (2231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:52:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.236s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774c283d-e979-4d40-8f7a-1fbc5edc71c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9014571-7886-4c07-99c6-c847a7ceab71', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5322f5-5a4e-471c-bbc4-a1b05d9ebb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:03 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Volume volume-c9014571-7886-4c07-99c6-c847a7ceab71 (c9014571-7886-4c07-99c6-c847a7ceab71): created successfully Jul 06 20:52:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5322f5-5a4e-471c-bbc4-a1b05d9ebb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Flow 'volume_create_manager' (b80ceb81-54db-4438-b027-1b75c32bfc5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:52:03 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-24cc87db-6090-496a-bb72-d3714cbd1894 tempest-VolumesListAdminTestJSON-1419167298 None] Created volume successfully. Jul 06 20:52:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] Acquiring lock "cinder-c9014571-7886-4c07-99c6-c847a7ceab71-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] Lock "cinder-c9014571-7886-4c07-99c6-c847a7ceab71-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] Acquiring lock "cinder-quobyte-c9014571-7886-4c07-99c6-c847a7ceab71" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] Lock "cinder-quobyte-c9014571-7886-4c07-99c6-c847a7ceab71" acquired by "delete_volume" :: waited 0.029s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:04 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a1eb8f-2daf-4d0b-831f-219ab99468f9]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c9014571-7886-4c07-99c6-c847a7ceab71 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] Acquiring lock "cinder-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] Lock "cinder-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] Acquiring lock "cinder-quobyte-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] Lock "cinder-quobyte-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7" acquired by "delete_volume" :: waited 0.029s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:04 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c9014571-7886-4c07-99c6-c847a7ceab71 Jul 06 20:52:04 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:04 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed64594-bee2-4dfc-8d9e-ddd5548c74d6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:04 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7 Jul 06 20:52:04 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:05 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c9014571-7886-4c07-99c6-c847a7ceab71" returned: 0 in 1.219s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c9014571-7886-4c07-99c6-c847a7ceab71 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:05 devstack sudo[95159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c9014571-7886-4c07-99c6-c847a7ceab71 Jul 06 20:52:05 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-c8118632-26c5-4078-ac9e-fae03ca860c2 req-d47d3794-4042-42bd-9e5e-43209f0776e0 tempest-AttachVolumeNegativeTest-2089758529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-c8118632-26c5-4078-ac9e-fae03ca860c2 req-d47d3794-4042-42bd-9e5e-43209f0776e0 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:05 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[702b225c-ca2e-4b8b-81f3-d171eb645e66]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-c8118632-26c5-4078-ac9e-fae03ca860c2 req-d47d3794-4042-42bd-9e5e-43209f0776e0 tempest-AttachVolumeNegativeTest-2089758529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6ef762c-954d-431b-bd8b-4159fcae7e97 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:05 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7" returned: 0 in 1.229s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:05 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7 Jul 06 20:52:05 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:05 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6ef762c-954d-431b-bd8b-4159fcae7e97 Jul 06 20:52:05 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:06 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c9014571-7886-4c07-99c6-c847a7ceab71" returned: 0 in 1.314s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] Lock "cinder-quobyte-c9014571-7886-4c07-99c6-c847a7ceab71" released by "delete_volume" :: held 2.613s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:52:06 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] Created reservations ['5066f0d2-7924-4a38-a7b3-fd88b3449959', '5fee6662-9d8f-48c4-a519-84028ff36494', 'f81d3be2-4336-4ae4-8981-825b0d670b5a', 'f9299bf4-b9d1-4e18-a2bd-beffe1aba069'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:52:07 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7" returned: 0 in 1.185s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] Lock "cinder-quobyte-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7" released by "delete_volume" :: held 2.487s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:52:07 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:52:07 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] Created reservations ['0df5d39f-aa75-419f-ac5d-77fa08766453', '787d4860-0af2-4759-b8ad-ff698c930689', '8596acb6-3369-407a-b1aa-18b09e2c107d', '040a8160-a9a9-4471-b44d-50179f0d684d'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:52:07 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-c8118632-26c5-4078-ac9e-fae03ca860c2 req-d47d3794-4042-42bd-9e5e-43209f0776e0 tempest-AttachVolumeNegativeTest-2089758529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6ef762c-954d-431b-bd8b-4159fcae7e97" returned: 0 in 1.407s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-c8118632-26c5-4078-ac9e-fae03ca860c2 req-d47d3794-4042-42bd-9e5e-43209f0776e0 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.438s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:07 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:52:07 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-c8118632-26c5-4078-ac9e-fae03ca860c2 req-d47d3794-4042-42bd-9e5e-43209f0776e0 tempest-AttachVolumeNegativeTest-2089758529 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-e6ef762c-954d-431b-bd8b-4159fcae7e97', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b401981-6024-46c3-8b03-fa7ad8155b60', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 20:52:07 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-c8118632-26c5-4078-ac9e-fae03ca860c2 req-d47d3794-4042-42bd-9e5e-43209f0776e0 tempest-AttachVolumeNegativeTest-2089758529 None] attachment_update completed successfully. Jul 06 20:52:07 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.783s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:52:07 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] Deleted volume successfully. Jul 06 20:52:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e2d30590-03da-4c20-b381-7590e7739460 tempest-VolumesListAdminTestJSON-1419167298 None] Lock "cinder-c9014571-7886-4c07-99c6-c847a7ceab71-delete_volume" released by "delete_volume" :: held 3.733s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:52:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] Acquiring lock "cinder-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:08 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.027s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:08 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:52:08 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] Deleted volume successfully. Jul 06 20:52:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] Lock "cinder-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1d6250ff-3a7d-4c8b-ba1d-9b8aa7307384 tempest-VolumesListAdminTestJSON-181466438 None] Lock "cinder-16eff90f-b6d6-4bbe-9c41-d2dbc069aaf7-delete_volume" released by "delete_volume" :: held 3.834s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:52:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] Acquiring lock "cinder-quobyte-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] Lock "cinder-quobyte-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b" acquired by "delete_volume" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:08 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e370fa75-0e35-4f28-9f41-9d0a170feaec]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:08 devstack sudo[95275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b Jul 06 20:52:08 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:09 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b" returned: 0 in 1.115s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:09 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b Jul 06 20:52:09 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:10 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b" returned: 0 in 0.730s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] Lock "cinder-quobyte-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b" released by "delete_volume" :: held 1.905s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:52:10 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] Created reservations ['74e11360-64e1-45bf-997f-877ce844b998', '38aa63d0-936d-4800-9067-c1fe87b868f5', '46261930-41ec-4a14-97bc-e50785d04e02', 'c750913d-eb00-4bb4-8713-88928ccf36b6'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:52:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:10 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:52:10 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] Acquiring lock "cinder-99a2d562-9528-4d16-9a25-7b89ad104eb1-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] Lock "cinder-99a2d562-9528-4d16-9a25-7b89ad104eb1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] Acquiring lock "cinder-quobyte-99a2d562-9528-4d16-9a25-7b89ad104eb1" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] Lock "cinder-quobyte-99a2d562-9528-4d16-9a25-7b89ad104eb1" acquired by "delete_volume" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:10 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e44cf27-07f6-4456-bc11-cf0ad2dee0ed]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99a2d562-9528-4d16-9a25-7b89ad104eb1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:11 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99a2d562-9528-4d16-9a25-7b89ad104eb1 Jul 06 20:52:11 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:11 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.923s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:11 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:52:11 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] Deleted volume successfully. Jul 06 20:52:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0aca8abd-7fdf-43d5-8746-0b5c4e91d397 tempest-VolumesListAdminTestJSON-181466438 None] Lock "cinder-7bde74b5-4143-4a86-8ea1-6b8dea8fd81b-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:52:11 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:52:11 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Flow 'volume_create_manager' (34d68edb-9794-4ffb-a5c2-30f525175cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:52:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d11a18e-516a-4713-a3da-d65282c9f87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99a2d562-9528-4d16-9a25-7b89ad104eb1" returned: 0 in 1.084s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99a2d562-9528-4d16-9a25-7b89ad104eb1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:12 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99a2d562-9528-4d16-9a25-7b89ad104eb1 Jul 06 20:52:12 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d11a18e-516a-4713-a3da-d65282c9f87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1346036758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c70980e-3f0c-42cb-abb7-4e0556ac656a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657ca59718d34f74ac62ab603d84b1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:12Z,use_quota=True,user_id='2bf3705f8bd945c4b98fd07aec6e1f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad5b2115-7810-4b75-bb0a-b90d0ea288de),volume_type_id=ad5b2115-7810-4b75-bb0a-b90d0ea288de)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2bf16d-b3a2-40fd-83cb-edaeadb79be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2bf16d-b3a2-40fd-83cb-edaeadb79be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15e99be-6a9b-43f5-b717-fd1704c69598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15e99be-6a9b-43f5-b717-fd1704c69598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c70980e-3f0c-42cb-abb7-4e0556ac656a', 'volume_name': 'volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2110af9d-5681-4027-9291-a1a216377ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2110af9d-5681-4027-9291-a1a216377ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e2f197-a041-4800-84e1-5e0935cb0334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:12 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Volume 7c70980e-3f0c-42cb-abb7-4e0556ac656a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a', 'volume_size': 1} Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1346036758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c70980e-3f0c-42cb-abb7-4e0556ac656a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657ca59718d34f74ac62ab603d84b1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:12Z,use_quota=True,user_id='2bf3705f8bd945c4b98fd07aec6e1f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad5b2115-7810-4b75-bb0a-b90d0ea288de),volume_type_id=ad5b2115-7810-4b75-bb0a-b90d0ea288de)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Creating volume 7c70980e-3f0c-42cb-abb7-4e0556ac656a {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:52:12 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:52:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:12 devstack sudo[95648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a 1073741824 Jul 06 20:52:12 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Flow 'volume_create_manager' (d9e6fb51-52e3-44fe-9322-6fd6b96a1e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396a319c-b387-4dae-b845-3f6a3d5e5742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396a319c-b387-4dae-b845-3f6a3d5e5742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-884166102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8b33e5-9b52-4193-a09a-aa0c75b03d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657ca59718d34f74ac62ab603d84b1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:13Z,use_quota=True,user_id='2bf3705f8bd945c4b98fd07aec6e1f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf57a7ad-c4ff-401a-9f4c-ac1539b791fb),volume_type_id=bf57a7ad-c4ff-401a-9f4c-ac1539b791fb)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8143ffa1-d8c9-422a-b702-c9b44c5a1c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8143ffa1-d8c9-422a-b702-c9b44c5a1c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d39837-4a0b-4473-a18e-3263def876d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d39837-4a0b-4473-a18e-3263def876d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff8b33e5-9b52-4193-a09a-aa0c75b03d68', 'volume_name': 'volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c5fefe-04fa-46ae-b104-a5b8dfe68fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c5fefe-04fa-46ae-b104-a5b8dfe68fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1d69c2-dfae-4794-a8d1-ccb53fad3d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:13 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Volume ff8b33e5-9b52-4193-a09a-aa0c75b03d68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68', 'volume_size': 1} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:13 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99a2d562-9528-4d16-9a25-7b89ad104eb1" returned: 0 in 1.456s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] Lock "cinder-quobyte-99a2d562-9528-4d16-9a25-7b89ad104eb1" released by "delete_volume" :: held 2.646s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] Created reservations ['b9d2c128-34a6-45f2-b0af-ca514d0404ef', '24d2d593-7c74-408a-82ee-8a8bc5fe355e', '32eb30fc-d59c-433e-aa8b-414c65821f7e', 'cbd3c779-3f41-48a9-a50d-99e1e508bf0e'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:13 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:52:13 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:14 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a 1073741824" returned: 0 in 1.864s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:14 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:52:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Flow 'volume_create_manager' (096ecfe5-737f-4f97-b329-887f670d93af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:52:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7e18ee-f222-404a-94df-d4e1a535199e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7e18ee-f222-404a-94df-d4e1a535199e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1906808650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=582a8d51-b032-485f-a198-3cab8f34f57f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657ca59718d34f74ac62ab603d84b1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:14Z,use_quota=True,user_id='2bf3705f8bd945c4b98fd07aec6e1f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed89ebce-b40b-4ea0-a189-5bf29eaf2b68),volume_type_id=ed89ebce-b40b-4ea0-a189-5bf29eaf2b68)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09d0610-6bdc-49b2-96fc-0d02f12f0644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09d0610-6bdc-49b2-96fc-0d02f12f0644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ab7153-5d14-485b-a701-06bfedf58c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:14 devstack cinder-volume[87207]: DEBUG cinder.image.glance [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Creating Keystone auth plugin from conf {{(pid=87207) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 20:52:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:14 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a Jul 06 20:52:14 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:14 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.257s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:14 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ab7153-5d14-485b-a701-06bfedf58c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '582a8d51-b032-485f-a198-3cab8f34f57f', 'volume_name': 'volume-582a8d51-b032-485f-a198-3cab8f34f57f', 'volume_size': 1, 'image_id': '0af082cb-9265-4e3d-b29a-db95b187889e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0af082cb-9265-4e3d-b29a-db95b187889e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1951243512', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '657ca59718d34f74ac62ab603d84b1cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0af082cb-9265-4e3d-b29a-db95b187889e', 'created_at': datetime.datetime(2026, 7, 6, 18, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 52, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0af082cb-9265-4e3d-b29a-db95b187889e/file', 'properties': {}}, 'image_service': }' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3104436d-6359-4a34-a3bc-5a73859924ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3104436d-6359-4a34-a3bc-5a73859924ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9f18c1-7062-4e46-9d99-2a992a6f95a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:15 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Volume 582a8d51-b032-485f-a198-3cab8f34f57f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-582a8d51-b032-485f-a198-3cab8f34f57f', 'volume_size': 1, 'image_id': '0af082cb-9265-4e3d-b29a-db95b187889e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0af082cb-9265-4e3d-b29a-db95b187889e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1951243512', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '657ca59718d34f74ac62ab603d84b1cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0af082cb-9265-4e3d-b29a-db95b187889e', 'created_at': datetime.datetime(2026, 7, 6, 18, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 52, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0af082cb-9265-4e3d-b29a-db95b187889e/file', 'properties': {}}, 'image_service': } Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Trying to clone 582a8d51-b032-485f-a198-3cab8f34f57f from image 0af082cb-9265-4e3d-b29a-db95b187889e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0af082cb-9265-4e3d-b29a-db95b187889e', 'metadata': {}}]). {{(pid=87207) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 20:52:15 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] Deleted volume successfully. Jul 06 20:52:15 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-1ccbd75a-df5f-44f6-9696-5d5f54e4e054 req-7e4a90e7-8394-4e59-8ab1-b58b75be6d15 tempest-AttachVolumeNegativeTest-2089758529 None] Terminate volume connection completed successfully. Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-1ccbd75a-df5f-44f6-9696-5d5f54e4e054 req-7e4a90e7-8394-4e59-8ab1-b58b75be6d15 tempest-AttachVolumeNegativeTest-2089758529 None] Deleting attachment 6b401981-6024-46c3-8b03-fa7ad8155b60. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-03d65108-90b1-49d2-9421-a67c29016235 tempest-VolumesListAdminTestJSON-181466438 None] Lock "cinder-99a2d562-9528-4d16-9a25-7b89ad104eb1-delete_volume" released by "delete_volume" :: held 4.461s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:52:15 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a" returned: 0 in 1.330s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] <== create_volume: return (3368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.371s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.521s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-884166102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8b33e5-9b52-4193-a09a-aa0c75b03d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657ca59718d34f74ac62ab603d84b1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:13Z,use_quota=True,user_id='2bf3705f8bd945c4b98fd07aec6e1f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf57a7ad-c4ff-401a-9f4c-ac1539b791fb),volume_type_id=bf57a7ad-c4ff-401a-9f4c-ac1539b791fb)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Creating volume ff8b33e5-9b52-4193-a09a-aa0c75b03d68 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:52:15 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e2f197-a041-4800-84e1-5e0935cb0334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:15 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68 1073741824 Jul 06 20:52:15 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc0e1c9-1f43-4752-a212-272a0c1e3285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:15 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Volume volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a (7c70980e-3f0c-42cb-abb7-4e0556ac656a): created successfully Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc0e1c9-1f43-4752-a212-272a0c1e3285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Flow 'volume_create_manager' (34d68edb-9794-4ffb-a5c2-30f525175cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:52:15 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-5b6e34e2-8b02-4571-9c88-1323e3f76885 tempest-TestInstancesWithCinderVolumes-1294367857 None] Created volume successfully. Jul 06 20:52:16 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68 1073741824" returned: 0 in 1.242s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:17 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68 Jul 06 20:52:17 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:18 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68" returned: 0 in 1.231s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] <== create_volume: return (2557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:52:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.564s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1d69c2-dfae-4794-a8d1-ccb53fad3d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab2991c-0517-4a0d-89b7-89818da3a449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:18 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Volume volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68 (ff8b33e5-9b52-4193-a09a-aa0c75b03d68): created successfully Jul 06 20:52:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab2991c-0517-4a0d-89b7-89818da3a449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Flow 'volume_create_manager' (d9e6fb51-52e3-44fe-9322-6fd6b96a1e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:52:18 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-762b2ae4-591c-4733-ab06-e074f1d01eeb tempest-TestInstancesWithCinderVolumes-1294367857 None] Created volume successfully. Jul 06 20:52:20 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0af082cb-9265-4e3d-b29a-db95b187889e_r0w0vb1udevstack@QuobyteHD, size 20.69 MB, duration 5.71 sec {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 20:52:20 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Image download 20.69 MB at 3.63 MB/s Jul 06 20:52:20 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5280bf-edb1-4a3c-ab11-04182fe7a3e9]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0af082cb-9265-4e3d-b29a-db95b187889e_r0w0vb1udevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:21 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0af082cb-9265-4e3d-b29a-db95b187889e_r0w0vb1udevstack@QuobyteHD Jul 06 20:52:21 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:22 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0af082cb-9265-4e3d-b29a-db95b187889e_r0w0vb1udevstack@QuobyteHD" returned: 0 in 1.121s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:22 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Temporary image 0af082cb-9265-4e3d-b29a-db95b187889e is fetched for user 2bf3705f8bd945c4b98fd07aec6e1f74. {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 20:52:22 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[663b51e7-8ff3-4087-ac40-04735f035cef]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0af082cb-9265-4e3d-b29a-db95b187889e_r0w0vb1udevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:22 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0af082cb-9265-4e3d-b29a-db95b187889e_r0w0vb1udevstack@QuobyteHD Jul 06 20:52:22 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:22 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:52:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Flow 'volume_create_manager' (31e5c44e-3cc0-4183-ac05-0e8edf0c999f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:52:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb58d1f-d0c9-4c0c-b79c-1a51b372c11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb58d1f-d0c9-4c0c-b79c-1a51b372c11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1064903798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0865f7cc-6aad-468e-bb25-1f9941e7f01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a64b949b0464a15a1a2229dbfbc1b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:22Z,use_quota=True,user_id='4cd6df66a78544258f819df868123662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21c263c-a310-4afd-ac51-245fc3cd9e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21c263c-a310-4afd-ac51-245fc3cd9e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7108941-4858-43ae-ae8a-a3860c1cda8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:22 devstack cinder-volume[87207]: DEBUG cinder.image.glance [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Creating Keystone auth plugin from conf {{(pid=87207) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 20:52:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7108941-4858-43ae-ae8a-a3860c1cda8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0865f7cc-6aad-468e-bb25-1f9941e7f01e', 'volume_name': 'volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e', 'volume_size': 1, 'image_id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6600b41119584a67ac9b8504a63b23ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2b4cef-1635-40bd-b970-751caee0eee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2b4cef-1635-40bd-b970-751caee0eee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb70e1b-40f2-474e-b2ae-fc9eca396d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:22 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Volume 0865f7cc-6aad-468e-bb25-1f9941e7f01e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e', 'volume_size': 1, 'image_id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6600b41119584a67ac9b8504a63b23ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 20:52:22 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Trying to clone 0865f7cc-6aad-468e-bb25-1f9941e7f01e from image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d at location (None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}]). {{(pid=87207) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 20:52:23 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_ful1f799devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 20:52:23 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Image download 20.69 MB at 20.69 MB/s Jul 06 20:52:23 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0af082cb-9265-4e3d-b29a-db95b187889e_r0w0vb1udevstack@QuobyteHD" returned: 0 in 1.002s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1906808650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=582a8d51-b032-485f-a198-3cab8f34f57f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657ca59718d34f74ac62ab603d84b1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:14Z,use_quota=True,user_id='2bf3705f8bd945c4b98fd07aec6e1f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed89ebce-b40b-4ea0-a189-5bf29eaf2b68),volume_type_id=ed89ebce-b40b-4ea0-a189-5bf29eaf2b68)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:52:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Creating volume 582a8d51-b032-485f-a198-3cab8f34f57f {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:52:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:52:23 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:52:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:23 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f 1073741824 Jul 06 20:52:23 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:23 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bc2e86-165d-47ea-9c84-9a789bf7c8d2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_ful1f799devstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:23 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_ful1f799devstack@QuobyteHD Jul 06 20:52:23 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:24 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_ful1f799devstack@QuobyteHD" returned: 0 in 0.856s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Temporary image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d is fetched for user 4cd6df66a78544258f819df868123662. {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9a308e-37cf-4faf-8228-8c4804a0557a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_ful1f799devstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:24 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f 1073741824" returned: 0 in 1.028s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:24 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_ful1f799devstack@QuobyteHD Jul 06 20:52:24 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:24 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f Jul 06 20:52:24 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:24 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f" returned: 0 in 0.675s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:24 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_ful1f799devstack@QuobyteHD" returned: 0 in 0.775s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1064903798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0865f7cc-6aad-468e-bb25-1f9941e7f01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a64b949b0464a15a1a2229dbfbc1b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:22Z,use_quota=True,user_id='4cd6df66a78544258f819df868123662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Creating volume 0865f7cc-6aad-468e-bb25-1f9941e7f01e {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:52:24 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Attempting download of 0af082cb-9265-4e3d-b29a-db95b187889e ((None, [{'url': 'file:///opt/stack/data/glance/images/0af082cb-9265-4e3d-b29a-db95b187889e', 'metadata': {}}])) to volume 582a8d51-b032-485f-a198-3cab8f34f57f. {{(pid=87207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 20:52:24 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e 1073741824 Jul 06 20:52:24 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1411b277-f6b1-4ed0-ac63-1dd775141892]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0af082cb-9265-4e3d-b29a-db95b187889e_96l2xc4_ {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:25 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0af082cb-9265-4e3d-b29a-db95b187889e_96l2xc4_ Jul 06 20:52:25 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:25 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e 1073741824" returned: 0 in 0.853s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:25 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0af082cb-9265-4e3d-b29a-db95b187889e_96l2xc4_" returned: 0 in 0.782s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0af082cb-9265-4e3d-b29a-db95b187889e_96l2xc4_ {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:25 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e Jul 06 20:52:25 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:25 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0af082cb-9265-4e3d-b29a-db95b187889e_96l2xc4_ Jul 06 20:52:25 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:26 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e" returned: 0 in 0.708s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:52:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:26 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Attempting download of 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d ((None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}])) to volume 0865f7cc-6aad-468e-bb25-1f9941e7f01e. {{(pid=87207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 20:52:26 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0af082cb-9265-4e3d-b29a-db95b187889e_96l2xc4_" returned: 1 in 0.780s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0af082cb-9265-4e3d-b29a-db95b187889e_96l2xc4_' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:52:26 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40b6d95-5948-409c-b71b-e7abfeef5541]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0af082cb-9265-4e3d-b29a-db95b187889e_r0w0vb1udevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:26 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e65dd1-9279-4e45-a311-9c4d0d78fbd5]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_m9f9g0z5 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:26 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0af082cb-9265-4e3d-b29a-db95b187889e_r0w0vb1udevstack@QuobyteHD Jul 06 20:52:26 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:26 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_m9f9g0z5 Jul 06 20:52:26 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] Acquiring lock "cinder-e6ef762c-954d-431b-bd8b-4159fcae7e97-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "cinder-e6ef762c-954d-431b-bd8b-4159fcae7e97-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] Acquiring lock "cinder-quobyte-e6ef762c-954d-431b-bd8b-4159fcae7e97" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "cinder-quobyte-e6ef762c-954d-431b-bd8b-4159fcae7e97" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:27 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[00054d4e-56f1-4749-9bf5-e3e47319d4b4]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6ef762c-954d-431b-bd8b-4159fcae7e97 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:27 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6ef762c-954d-431b-bd8b-4159fcae7e97 Jul 06 20:52:27 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:27 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0af082cb-9265-4e3d-b29a-db95b187889e_r0w0vb1udevstack@QuobyteHD" returned: 0 in 0.821s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:27 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] 0af082cb-9265-4e3d-b29a-db95b187889e was qcow2, converting to raw {{(pid=87207) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 20:52:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0af082cb-9265-4e3d-b29a-db95b187889e_r0w0vb1udevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:27 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_m9f9g0z5" returned: 0 in 0.802s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_m9f9g0z5 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:27 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0af082cb-9265-4e3d-b29a-db95b187889e_r0w0vb1udevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f Jul 06 20:52:27 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:27 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_m9f9g0z5 Jul 06 20:52:27 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:28 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6ef762c-954d-431b-bd8b-4159fcae7e97" returned: 0 in 0.870s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6ef762c-954d-431b-bd8b-4159fcae7e97 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:28 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6ef762c-954d-431b-bd8b-4159fcae7e97 Jul 06 20:52:28 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:28 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_m9f9g0z5" returned: 1 in 0.753s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_m9f9g0z5' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:52:28 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a236b4ec-353c-4e3e-8979-7f2a78d27345]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_ful1f799devstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:28 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_ful1f799devstack@QuobyteHD Jul 06 20:52:28 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:28 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6ef762c-954d-431b-bd8b-4159fcae7e97" returned: 0 in 0.664s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:28 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "cinder-quobyte-e6ef762c-954d-431b-bd8b-4159fcae7e97" released by "delete_volume" :: held 1.592s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:52:28 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] Created reservations ['5bdf464a-d083-492a-b2b3-685a0593e8ee', '53f841f9-9823-4c30-8ee0-4a5830cc2a80', 'b36bcfc7-c57b-4104-91d5-c1a76addd940', '8d444ec3-fbf9-4998-81e2-ef265969e61f'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:52:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:28 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:28 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:28 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:52:28 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:29 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_ful1f799devstack@QuobyteHD" returned: 0 in 0.887s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:29 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d was qcow2, converting to raw {{(pid=87207) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 20:52:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_ful1f799devstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:29 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_ful1f799devstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e Jul 06 20:52:29 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:29 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0af082cb-9265-4e3d-b29a-db95b187889e_r0w0vb1udevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f" returned: 0 in 1.939s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:29 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0af082cb-9265-4e3d-b29a-db95b187889e_r0w0vb1udevstack@QuobyteHD, size 112.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 20:52:29 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Converted 112.00 MB image at 57.73 MB/s Jul 06 20:52:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:29 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f 1G Jul 06 20:52:29 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:29 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] Acquiring lock "cinder-8b50bf9c-34df-42ac-86a2-0be20daa0141-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:29 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "cinder-8b50bf9c-34df-42ac-86a2-0be20daa0141-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:29 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] Acquiring lock "cinder-quobyte-8b50bf9c-34df-42ac-86a2-0be20daa0141" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:29 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "cinder-quobyte-8b50bf9c-34df-42ac-86a2-0be20daa0141" acquired by "delete_volume" :: waited 0.031s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:29 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.784s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:29 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:52:29 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] Deleted volume successfully. Jul 06 20:52:29 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[908d3aa6-242f-4ea4-83b1-7db8a033c8cc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b50bf9c-34df-42ac-86a2-0be20daa0141 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:29 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9669f439-2f81-4558-9849-affaf9d771f5 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "cinder-e6ef762c-954d-431b-bd8b-4159fcae7e97-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:52:29 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b50bf9c-34df-42ac-86a2-0be20daa0141 Jul 06 20:52:29 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:30 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f 1G" returned: 0 in 1.154s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:30 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c43de37-3a1c-4e65-851d-0acb9f033c57]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:30 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b50bf9c-34df-42ac-86a2-0be20daa0141" returned: 0 in 0.869s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b50bf9c-34df-42ac-86a2-0be20daa0141 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:30 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b50bf9c-34df-42ac-86a2-0be20daa0141 Jul 06 20:52:30 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:30 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f Jul 06 20:52:30 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:31 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b50bf9c-34df-42ac-86a2-0be20daa0141" returned: 0 in 0.786s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:31 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "cinder-quobyte-8b50bf9c-34df-42ac-86a2-0be20daa0141" released by "delete_volume" :: held 1.715s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:52:31 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] Created reservations ['ff64eb88-b457-40e0-a3cf-08f89cd02e85', '4fed5a0b-ff0c-4efb-933d-af93c283d6b6', '0784e4b0-a9de-46c4-ac93-d137b5b578eb', '3bdea0dc-f901-4953-8fd5-b15523b7df72'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:52:31 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_ful1f799devstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e" returned: 0 in 2.500s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:31 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_ful1f799devstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 20:52:31 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Converted 112.00 MB image at 44.76 MB/s Jul 06 20:52:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:31 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e 1G Jul 06 20:52:31 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:31 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:52:31 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:31 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f" returned: 0 in 1.159s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:31 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f Jul 06 20:52:31 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] Acquiring lock "cinder-048e2584-4faa-4760-9e90-79ebed252910-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "cinder-048e2584-4faa-4760-9e90-79ebed252910-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] Acquiring lock "cinder-quobyte-048e2584-4faa-4760-9e90-79ebed252910" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "cinder-quobyte-048e2584-4faa-4760-9e90-79ebed252910" acquired by "delete_volume" :: waited 0.034s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[641a05b8-e443-4c1e-8a89-fe60bcedc5de]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-048e2584-4faa-4760-9e90-79ebed252910 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:32 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-048e2584-4faa-4760-9e90-79ebed252910 Jul 06 20:52:32 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:32 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e 1G" returned: 0 in 0.975s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:32 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.938s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:52:32 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] Deleted volume successfully. Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d700275-8778-4313-85e7-b183c84290ce]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-67513a65-ba5a-4fd4-870b-c6bb990a6ad5 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "cinder-8b50bf9c-34df-42ac-86a2-0be20daa0141-delete_volume" released by "delete_volume" :: held 3.012s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:52:32 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f" returned: 1 in 0.948s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Downloaded image 0af082cb-9265-4e3d-b29a-db95b187889e ((None, [{'url': 'file:///opt/stack/data/glance/images/0af082cb-9265-4e3d-b29a-db95b187889e', 'metadata': {}}])) to volume 582a8d51-b032-485f-a198-3cab8f34f57f successfully. {{(pid=87207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Temporary image 0af082cb-9265-4e3d-b29a-db95b187889e for user 2bf3705f8bd945c4b98fd07aec6e1f74 is deleted. {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Marking volume 582a8d51-b032-485f-a198-3cab8f34f57f as bootable. {{(pid=87207) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Copying metadata from image 0af082cb-9265-4e3d-b29a-db95b187889e to 582a8d51-b032-485f-a198-3cab8f34f57f. {{(pid=87207) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Creating volume glance metadata for volume 582a8d51-b032-485f-a198-3cab8f34f57f backed by image 0af082cb-9265-4e3d-b29a-db95b187889e with: {'image_id': '0af082cb-9265-4e3d-b29a-db95b187889e', 'image_name': 'tempest-scenario-img--1951243512', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87207) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 20:52:32 devstack sudo[95882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e Jul 06 20:52:32 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9f18c1-7062-4e46-9d99-2a992a6f95a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-582a8d51-b032-485f-a198-3cab8f34f57f', 'volume_size': 1, 'image_id': '0af082cb-9265-4e3d-b29a-db95b187889e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0af082cb-9265-4e3d-b29a-db95b187889e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1951243512', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '657ca59718d34f74ac62ab603d84b1cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0af082cb-9265-4e3d-b29a-db95b187889e', 'created_at': datetime.datetime(2026, 7, 6, 18, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 52, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0af082cb-9265-4e3d-b29a-db95b187889e/file', 'properties': {}}, 'image_service': }' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893217f7-daa5-4fa1-852e-fe620c9a41a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:32 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Volume volume-582a8d51-b032-485f-a198-3cab8f34f57f (582a8d51-b032-485f-a198-3cab8f34f57f): created successfully Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893217f7-daa5-4fa1-852e-fe620c9a41a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:32 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Flow 'volume_create_manager' (096ecfe5-737f-4f97-b329-887f670d93af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:52:32 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-46276c8f-6bc5-4c6a-9db1-b2284347077b tempest-TestInstancesWithCinderVolumes-1294367857 None] Created volume successfully. Jul 06 20:52:33 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-048e2584-4faa-4760-9e90-79ebed252910" returned: 0 in 0.858s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-048e2584-4faa-4760-9e90-79ebed252910 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:33 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-048e2584-4faa-4760-9e90-79ebed252910 Jul 06 20:52:33 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:33 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e" returned: 0 in 0.859s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:33 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e Jul 06 20:52:33 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:33 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-048e2584-4faa-4760-9e90-79ebed252910" returned: 0 in 0.702s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "cinder-quobyte-048e2584-4faa-4760-9e90-79ebed252910" released by "delete_volume" :: held 1.620s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:52:33 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] Created reservations ['9da0d60d-80c1-4d6e-acf4-288511c4fb7f', '1d815910-cf04-4685-a8c4-7b56d57077ee', '3666b5cc-3275-45f9-b02c-6dea4639dda2', 'cd69c411-49f5-4393-b3a2-8c8929abb87f'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:52:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:33 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:52:33 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:34 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e" returned: 1 in 0.855s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:52:34 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Downloaded image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d ((None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}])) to volume 0865f7cc-6aad-468e-bb25-1f9941e7f01e successfully. {{(pid=87207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 20:52:34 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Temporary image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d for user 4cd6df66a78544258f819df868123662 is deleted. {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 20:52:34 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Marking volume 0865f7cc-6aad-468e-bb25-1f9941e7f01e as bootable. {{(pid=87207) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 20:52:34 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Copying metadata from image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d to 0865f7cc-6aad-468e-bb25-1f9941e7f01e. {{(pid=87207) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 20:52:34 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Creating volume glance metadata for volume 0865f7cc-6aad-468e-bb25-1f9941e7f01e backed by image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87207) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 20:52:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb70e1b-40f2-474e-b2ae-fc9eca396d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e', 'volume_size': 1, 'image_id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6600b41119584a67ac9b8504a63b23ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d8b538-78c5-46f0-9ccd-0d868b40b74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:34 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Volume volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e (0865f7cc-6aad-468e-bb25-1f9941e7f01e): created successfully Jul 06 20:52:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d8b538-78c5-46f0-9ccd-0d868b40b74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Flow 'volume_create_manager' (31e5c44e-3cc0-4183-ac05-0e8edf0c999f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:52:34 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-fca8c159-53c4-4ee4-9fa9-6a10601c78f9 tempest-VolumesImageMetadata-1359490708 None] Created volume successfully. Jul 06 20:52:34 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.792s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:34 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:52:34 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] Deleted volume successfully. Jul 06 20:52:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ecc5574e-9f36-445d-bf1c-c30923ff0f38 tempest-AttachVolumeNegativeTest-2089758529 None] Lock "cinder-048e2584-4faa-4760-9e90-79ebed252910-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:52:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] Acquiring lock "cinder-0865f7cc-6aad-468e-bb25-1f9941e7f01e-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] Lock "cinder-0865f7cc-6aad-468e-bb25-1f9941e7f01e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] Acquiring lock "cinder-quobyte-0865f7cc-6aad-468e-bb25-1f9941e7f01e" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] Lock "cinder-quobyte-0865f7cc-6aad-468e-bb25-1f9941e7f01e" acquired by "delete_volume" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:35 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece1ff78-60c6-4452-8bb2-7b7c9c41b8cf]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:35 devstack sudo[95906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e Jul 06 20:52:35 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Flow 'volume_create_manager' (e9b8828d-9f18-4f49-be74-b77d3fbb6fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f98cca-47d0-45d7-ab93-fd84af3b7eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f98cca-47d0-45d7-ab93-fd84af3b7eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1703349946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ddc295-3b77-4a81-baed-928462dac744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0303e839f35e45118ed4651165208995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:36Z,use_quota=True,user_id='c38c2c31563a47a089248d4db3c4704d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f2c0d7-1c59-47ca-91ee-d4388c7d0f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f2c0d7-1c59-47ca-91ee-d4388c7d0f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598abd55-acfe-4a32-8619-37c14b8573f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598abd55-acfe-4a32-8619-37c14b8573f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ddc295-3b77-4a81-baed-928462dac744', 'volume_name': 'volume-62ddc295-3b77-4a81-baed-928462dac744', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f48564-ef72-4eb7-a4e3-09157750deea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f48564-ef72-4eb7-a4e3-09157750deea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313e7d0d-0718-4b02-92ee-0064e3674340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:36 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Volume 62ddc295-3b77-4a81-baed-928462dac744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ddc295-3b77-4a81-baed-928462dac744', 'volume_size': 1} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1703349946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ddc295-3b77-4a81-baed-928462dac744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0303e839f35e45118ed4651165208995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:36Z,use_quota=True,user_id='c38c2c31563a47a089248d4db3c4704d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Creating volume 62ddc295-3b77-4a81-baed-928462dac744 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:52:36 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62ddc295-3b77-4a81-baed-928462dac744 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:36 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62ddc295-3b77-4a81-baed-928462dac744 1073741824 Jul 06 20:52:36 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:36 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e" returned: 0 in 1.015s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:36 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e Jul 06 20:52:36 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:37 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e" returned: 1 in 0.867s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:52:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:37 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e Jul 06 20:52:37 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:38 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62ddc295-3b77-4a81-baed-928462dac744 1073741824" returned: 0 in 1.351s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62ddc295-3b77-4a81-baed-928462dac744 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:38 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62ddc295-3b77-4a81-baed-928462dac744 Jul 06 20:52:38 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:38 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0865f7cc-6aad-468e-bb25-1f9941e7f01e" returned: 0 in 1.065s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] Lock "cinder-quobyte-0865f7cc-6aad-468e-bb25-1f9941e7f01e" released by "delete_volume" :: held 3.026s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:52:38 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] Created reservations ['5cd150c7-50ab-4dcb-9f3c-8f235f1f338b', '692508c8-5075-4b33-8586-cc9edead4f29', 'a1491e7a-555e-454d-80a3-595cf64041d4', '0ad8c011-7779-4317-91ab-c77b9b54376a'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:52:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:39 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:52:39 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:39 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62ddc295-3b77-4a81-baed-928462dac744" returned: 0 in 0.888s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] <== create_volume: return (2319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:52:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.324s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313e7d0d-0718-4b02-92ee-0064e3674340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ddc295-3b77-4a81-baed-928462dac744', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7066f8-8627-4980-b9bc-652a6a120bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:39 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Volume volume-62ddc295-3b77-4a81-baed-928462dac744 (62ddc295-3b77-4a81-baed-928462dac744): created successfully Jul 06 20:52:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7066f8-8627-4980-b9bc-652a6a120bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Flow 'volume_create_manager' (e9b8828d-9f18-4f49-be74-b77d3fbb6fb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:52:39 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0d4890f7-4b79-4bee-b1d1-28689ec80fc3 tempest-AttachVolumeTestJSON-635946371 None] Created volume successfully. Jul 06 20:52:39 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.845s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:39 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:52:39 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] Deleted volume successfully. Jul 06 20:52:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-79fb90b7-7e1f-4a88-b405-378d1e81343f tempest-VolumesImageMetadata-1359490708 None] Lock "cinder-0865f7cc-6aad-468e-bb25-1f9941e7f01e-delete_volume" released by "delete_volume" :: held 4.221s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:52:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-b8b7e5c0-925f-451d-855a-290b69403601 req-5e940c72-6362-4de6-beeb-a6366bd058e8 tempest-TestInstancesWithCinderVolumes-1294367857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-b8b7e5c0-925f-451d-855a-290b69403601 req-5e940c72-6362-4de6-beeb-a6366bd058e8 tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:40 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce811a0-5cfa-42a1-9175-d03051b44f82]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-b8b7e5c0-925f-451d-855a-290b69403601 req-5e940c72-6362-4de6-beeb-a6366bd058e8 tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:40 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f Jul 06 20:52:40 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:41 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-b8b7e5c0-925f-451d-855a-290b69403601 req-5e940c72-6362-4de6-beeb-a6366bd058e8 tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f" returned: 0 in 0.877s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-b8b7e5c0-925f-451d-855a-290b69403601 req-5e940c72-6362-4de6-beeb-a6366bd058e8 tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:41 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f Jul 06 20:52:41 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:42 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-b8b7e5c0-925f-451d-855a-290b69403601 req-5e940c72-6362-4de6-beeb-a6366bd058e8 tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f" returned: 1 in 1.148s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-b8b7e5c0-925f-451d-855a-290b69403601 req-5e940c72-6362-4de6-beeb-a6366bd058e8 tempest-TestInstancesWithCinderVolumes-1294367857 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:52:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-b8b7e5c0-925f-451d-855a-290b69403601 req-5e940c72-6362-4de6-beeb-a6366bd058e8 tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.071s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:42 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=84,cinder:INSERT=34,cinder:UPDATE=100,cinder:DELETE=11 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:52:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-b8b7e5c0-925f-451d-855a-290b69403601 req-5e940c72-6362-4de6-beeb-a6366bd058e8 tempest-TestInstancesWithCinderVolumes-1294367857 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-582a8d51-b032-485f-a198-3cab8f34f57f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6363ffed-edaf-4f3b-8cc6-195fbb211a4e', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 20:52:42 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-b8b7e5c0-925f-451d-855a-290b69403601 req-5e940c72-6362-4de6-beeb-a6366bd058e8 tempest-TestInstancesWithCinderVolumes-1294367857 None] attachment_update completed successfully. Jul 06 20:52:43 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:UPDATE=100,cinder:SELECT=84,cinder:DELETE=7,cinder:INSERT=30 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:52:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-4dba0d98-4b16-4fe9-984c-e4067cf2c581 req-40f221f7-eb1e-48f5-9157-a2557bc7f43e tempest-AttachVolumeTestJSON-635946371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-4dba0d98-4b16-4fe9-984c-e4067cf2c581 req-40f221f7-eb1e-48f5-9157-a2557bc7f43e tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:43 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8cae1d-f18b-486c-be63-0aa608c5e991]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-4dba0d98-4b16-4fe9-984c-e4067cf2c581 req-40f221f7-eb1e-48f5-9157-a2557bc7f43e tempest-AttachVolumeTestJSON-635946371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62ddc295-3b77-4a81-baed-928462dac744 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:43 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62ddc295-3b77-4a81-baed-928462dac744 Jul 06 20:52:43 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:44 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-4dba0d98-4b16-4fe9-984c-e4067cf2c581 req-40f221f7-eb1e-48f5-9157-a2557bc7f43e tempest-AttachVolumeTestJSON-635946371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62ddc295-3b77-4a81-baed-928462dac744" returned: 0 in 0.993s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-4dba0d98-4b16-4fe9-984c-e4067cf2c581 req-40f221f7-eb1e-48f5-9157-a2557bc7f43e tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.039s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-4dba0d98-4b16-4fe9-984c-e4067cf2c581 req-40f221f7-eb1e-48f5-9157-a2557bc7f43e tempest-AttachVolumeTestJSON-635946371 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-62ddc295-3b77-4a81-baed-928462dac744', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67d0178f-d9b1-4673-a92f-52e92660f930', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 20:52:44 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-4dba0d98-4b16-4fe9-984c-e4067cf2c581 req-40f221f7-eb1e-48f5-9157-a2557bc7f43e tempest-AttachVolumeTestJSON-635946371 None] attachment_update completed successfully. Jul 06 20:52:44 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-a2e3ac6f-12f5-439f-93da-b959cd300d87 tempest-GroupSnapshotsTest-1634452977 None] Group tempest-GroupSnapshotsTest-Group-842702424: creating Jul 06 20:52:44 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-a2e3ac6f-12f5-439f-93da-b959cd300d87 tempest-GroupSnapshotsTest-1634452977 None] Group tempest-GroupSnapshotsTest-Group-842702424: created successfully Jul 06 20:52:44 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-a2e3ac6f-12f5-439f-93da-b959cd300d87 tempest-GroupSnapshotsTest-1634452977 None] Create group completed successfully. Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Flow 'volume_create_manager' (3a324fec-a444-4137-94a1-27debd3579af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1085300d-9f56-41cb-9804-4e65c21f38b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1085300d-9f56-41cb-9804-4e65c21f38b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-53618476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f40a7243-8705-4184-9199-759ffb5d2c06,host='devstack@QuobyteHD#QuobyteHD',id=99c12357-e718-488b-906b-dabdb49bd8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85478e6cf691404d8f4e6b3c9736a9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:46Z,use_quota=True,user_id='dbe258cbe9a24a428f1db480ccd86c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c47a95d-4622-4bf5-bea2-3ff7ebea1069),volume_type_id=8c47a95d-4622-4bf5-bea2-3ff7ebea1069)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b37991-1d4f-4302-8106-31dc5ac4c980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b37991-1d4f-4302-8106-31dc5ac4c980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a476b3f-3e65-48d9-bf7d-b7bde90332f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a476b3f-3e65-48d9-bf7d-b7bde90332f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99c12357-e718-488b-906b-dabdb49bd8a2', 'volume_name': 'volume-99c12357-e718-488b-906b-dabdb49bd8a2', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2c656e-7119-46b5-b42a-14fddf014801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2c656e-7119-46b5-b42a-14fddf014801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5262df5-f9db-4dbb-b1c2-0ab1a6ed7c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:46 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Volume 99c12357-e718-488b-906b-dabdb49bd8a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99c12357-e718-488b-906b-dabdb49bd8a2', 'volume_size': 1} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f40a7243-8705-4184-9199-759ffb5d2c06,created_at=2026-07-06T18:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-53618476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f40a7243-8705-4184-9199-759ffb5d2c06,host='devstack@QuobyteHD#QuobyteHD',id=99c12357-e718-488b-906b-dabdb49bd8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85478e6cf691404d8f4e6b3c9736a9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:46Z,use_quota=True,user_id='dbe258cbe9a24a428f1db480ccd86c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c47a95d-4622-4bf5-bea2-3ff7ebea1069),volume_type_id=8c47a95d-4622-4bf5-bea2-3ff7ebea1069)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Creating volume 99c12357-e718-488b-906b-dabdb49bd8a2 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:52:46 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:52:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:46 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 1073741824 Jul 06 20:52:46 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:47 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 1073741824" returned: 0 in 1.041s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:47 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 Jul 06 20:52:47 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Flow 'volume_create_manager' (3b15d58b-f16b-4ef2-870f-ae6e9125de4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c046f99-7a69-4fa5-b4d8-26e9c9d1a461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c046f99-7a69-4fa5-b4d8-26e9c9d1a461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2044755321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9614453-8636-4ad0-b2b4-915ad871e424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6254831fe04e8bb6004f0ce12a2555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:49Z,use_quota=True,user_id='8afcdbd711c449f7a80e1e4432f269a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:48 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d7a8374-e186-422d-bd0b-2b99bad83635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d7a8374-e186-422d-bd0b-2b99bad83635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52e135d-ef58-493a-9bbf-862540c16f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52e135d-ef58-493a-9bbf-862540c16f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9614453-8636-4ad0-b2b4-915ad871e424', 'volume_name': 'volume-e9614453-8636-4ad0-b2b4-915ad871e424', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68eec63c-77c6-423b-9f21-96443ff2433f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68eec63c-77c6-423b-9f21-96443ff2433f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344ec581-bb7b-438e-9636-4dd8c1ce6fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:48 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Volume e9614453-8636-4ad0-b2b4-915ad871e424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9614453-8636-4ad0-b2b4-915ad871e424', 'volume_size': 1} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2" returned: 0 in 0.927s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2044755321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9614453-8636-4ad0-b2b4-915ad871e424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6254831fe04e8bb6004f0ce12a2555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:49Z,use_quota=True,user_id='8afcdbd711c449f7a80e1e4432f269a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Creating volume e9614453-8636-4ad0-b2b4-915ad871e424 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:52:48 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e9614453-8636-4ad0-b2b4-915ad871e424 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5262df5-f9db-4dbb-b1c2-0ab1a6ed7c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99c12357-e718-488b-906b-dabdb49bd8a2', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b6a25a-5593-4aed-a302-80abe52e80e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:48 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e9614453-8636-4ad0-b2b4-915ad871e424 1073741824 Jul 06 20:52:48 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:48 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Volume volume-99c12357-e718-488b-906b-dabdb49bd8a2 (99c12357-e718-488b-906b-dabdb49bd8a2): created successfully Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b6a25a-5593-4aed-a302-80abe52e80e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Flow 'volume_create_manager' (3a324fec-a444-4137-94a1-27debd3579af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:52:48 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d92aef18-bc9c-47e3-936d-1d96b5d362e5 tempest-GroupSnapshotsTest-1634452977 None] Created volume successfully. Jul 06 20:52:49 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] GroupSnapshot 39a77489-09a4-46b0-ab57-73445d687422: creating. Jul 06 20:52:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] Group snapshot 39a77489-09a4-46b0-ab57-73445d687422: creating. {{(pid=87207) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 20:52:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:49 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e9614453-8636-4ad0-b2b4-915ad871e424 1073741824" returned: 0 in 1.155s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e9614453-8636-4ad0-b2b4-915ad871e424 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:49 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e9614453-8636-4ad0-b2b4-915ad871e424 Jul 06 20:52:49 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Flow 'volume_create_manager' (67053855-79f1-4465-988a-84f26ab014a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34466fb1-7eda-446d-80e1-7d531bb9c672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34466fb1-7eda-446d-80e1-7d531bb9c672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1719794225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f63bf4-103a-4557-af9d-ac8ff5ebdeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0303e839f35e45118ed4651165208995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:50Z,use_quota=True,user_id='c38c2c31563a47a089248d4db3c4704d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196b90d1-7270-4553-a0dc-39c7cc29c45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196b90d1-7270-4553-a0dc-39c7cc29c45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b4e243-3485-4d60-b34e-4e8768cfaf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b4e243-3485-4d60-b34e-4e8768cfaf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0f63bf4-103a-4557-af9d-ac8ff5ebdeef', 'volume_name': 'volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e8e155-9fd6-4401-98c6-cf21601b0334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e8e155-9fd6-4401-98c6-cf21601b0334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89abce82-1e52-4e02-baef-917831c84b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:50 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Volume e0f63bf4-103a-4557-af9d-ac8ff5ebdeef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef', 'volume_size': 1} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:50 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e9614453-8636-4ad0-b2b4-915ad871e424" returned: 0 in 0.891s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] <== create_volume: return (2116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.119s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.470s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344ec581-bb7b-438e-9636-4dd8c1ce6fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9614453-8636-4ad0-b2b4-915ad871e424', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fb9e28-8592-4987-aa43-dca645a23d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] Creating offline snapshot 901d17f9-4423-4213-99bc-4423753688ca of volume 99c12357-e718-488b-906b-dabdb49bd8a2 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bb6113-5887-4d3f-b7e4-6919d84c49e1]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:50 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Volume volume-e9614453-8636-4ad0-b2b4-915ad871e424 (e9614453-8636-4ad0-b2b4-915ad871e424): created successfully Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fb9e28-8592-4987-aa43-dca645a23d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Flow 'volume_create_manager' (3b15d58b-f16b-4ef2-870f-ae6e9125de4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:52:50 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d6f1803f-078c-4c4f-8dd8-e509905462b3 tempest-AbsoluteLimitsTests-715815527 None] Created volume successfully. Jul 06 20:52:50 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 Jul 06 20:52:50 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:51 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2" returned: 0 in 0.967s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:51 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca 1G Jul 06 20:52:51 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] Acquiring lock "cinder-e9614453-8636-4ad0-b2b4-915ad871e424-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] Lock "cinder-e9614453-8636-4ad0-b2b4-915ad871e424-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] Acquiring lock "cinder-quobyte-e9614453-8636-4ad0-b2b4-915ad871e424" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] Lock "cinder-quobyte-e9614453-8636-4ad0-b2b4-915ad871e424" acquired by "delete_volume" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:52 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f8b8cf-6bf8-4197-8fb7-a672d9bf9de2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e9614453-8636-4ad0-b2b4-915ad871e424 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:52 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e9614453-8636-4ad0-b2b4-915ad871e424 Jul 06 20:52:52 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:52 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca 1G" returned: 0 in 1.111s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99c12357-e718-488b-906b-dabdb49bd8a2 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:52 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99c12357-e718-488b-906b-dabdb49bd8a2 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca Jul 06 20:52:52 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:53 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e9614453-8636-4ad0-b2b4-915ad871e424" returned: 0 in 1.183s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e9614453-8636-4ad0-b2b4-915ad871e424 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:53 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e9614453-8636-4ad0-b2b4-915ad871e424 Jul 06 20:52:53 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:53 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99c12357-e718-488b-906b-dabdb49bd8a2 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca" returned: 0 in 0.942s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:53 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca is being set with open permissions: ugo+rw: NotImplementedError Jul 06 20:52:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:53 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca Jul 06 20:52:53 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:54 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e9614453-8636-4ad0-b2b4-915ad871e424" returned: 0 in 0.993s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] Lock "cinder-quobyte-e9614453-8636-4ad0-b2b4-915ad871e424" released by "delete_volume" :: held 2.255s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:52:54 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] Created reservations ['293a4596-41f3-4892-b730-490a8e2b2b5a', '0e97c784-9cbd-4581-b2f7-cafbe4b90a73', '8f3d1d80-0a14-4afd-ace4-851694986441', '547f41b7-275a-42ae-815d-e6cdf0bb92a0'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:52:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:54 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:52:54 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:54 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca" returned: 0 in 0.799s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:54 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.info Jul 06 20:52:54 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:55 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.info" returned: 0 in 0.784s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:55 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 20:52:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:55 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.info Jul 06 20:52:55 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:55 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.212s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:55 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:52:55 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] Deleted volume successfully. Jul 06 20:52:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-39c5a0c6-06ad-4433-a88d-cd6f3a4e591c tempest-AbsoluteLimitsTests-715815527 None] Lock "cinder-e9614453-8636-4ad0-b2b4-915ad871e424-delete_volume" released by "delete_volume" :: held 3.801s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:52:56 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.info" returned: 0 in 0.922s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.649s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.052s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1719794225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f63bf4-103a-4557-af9d-ac8ff5ebdeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0303e839f35e45118ed4651165208995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:50Z,use_quota=True,user_id='c38c2c31563a47a089248d4db3c4704d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:52:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Creating volume e0f63bf4-103a-4557-af9d-ac8ff5ebdeef {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:52:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:52:56 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:52:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:56 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef 1073741824 Jul 06 20:52:56 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:56 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-1d26cdff-7bc6-496b-90d7-7d2adac202c0 tempest-GroupSnapshotsTest-1634452977 None] group_snapshot 39a77489-09a4-46b0-ab57-73445d687422: created successfully Jul 06 20:52:57 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef 1073741824" returned: 0 in 1.396s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:57 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:52:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:58 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef Jul 06 20:52:58 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:58 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:52:58 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:52:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:59 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.128s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:52:59 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef" returned: 0 in 1.616s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] <== create_volume: return (3099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.106s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.827s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "cinder-quobyte-901d17f9-4423-4213-99bc-4423753688ca-c8d77368-19f0-4175-92fa-61bd9f60a6b0" by "_create_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89abce82-1e52-4e02-baef-917831c84b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed78325c-46c1-46cb-ae6f-ba7e5419c548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-901d17f9-4423-4213-99bc-4423753688ca-c8d77368-19f0-4175-92fa-61bd9f60a6b0" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Creating volume c8d77368-19f0-4175-92fa-61bd9f60a6b0 from snapshot 901d17f9-4423-4213-99bc-4423753688ca {{(pid=87207) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "cinder-quobyte-c8d77368-19f0-4175-92fa-61bd9f60a6b0" by "_copy_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:52:59 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Volume volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef (e0f63bf4-103a-4557-af9d-ac8ff5ebdeef): created successfully Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed78325c-46c1-46cb-ae6f-ba7e5419c548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Flow 'volume_create_manager' (67053855-79f1-4465-988a-84f26ab014a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-c8d77368-19f0-4175-92fa-61bd9f60a6b0" acquired by "_copy_volume_from_snapshot" :: waited 0.057s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] snapshot: 901d17f9-4423-4213-99bc-4423753688ca, volume: c8d77368-19f0-4175-92fa-61bd9f60a6b0, {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 20:52:59 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-77ad0583-561d-4ec3-9c56-5eca33d30b1d tempest-AttachVolumeTestJSON-635946371 None] Created volume successfully. Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[78322c5c-b03a-42ae-b2b5-95053b9bf311]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:52:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:52:59 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca Jul 06 20:52:59 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:01 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca" returned: 0 in 1.391s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99c12357-e718-488b-906b-dabdb49bd8a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:53:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 20:53:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Creating direct copy from snapshot {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 20:53:01 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8daa4f-e60c-4dbe-a31e-ab69d0417c57]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:01 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 Jul 06 20:53:01 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:02 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2" returned: 0 in 0.997s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:02 devstack cinder-volume[87207]: DEBUG cinder.utils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Path /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8d77368-19f0-4175-92fa-61bd9f60a6b0 not found in is_blk_device check {{(pid=87207) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 20:53:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8d77368-19f0-4175-92fa-61bd9f60a6b0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:02 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8d77368-19f0-4175-92fa-61bd9f60a6b0 Jul 06 20:53:02 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:02 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:53:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Flow 'volume_create_manager' (adb3970a-9eb2-42f4-b1dc-680d38c8259a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:53:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e04a8cd-556c-4b96-a444-5005277aeae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e04a8cd-556c-4b96-a444-5005277aeae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1728345265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76f6b9f-3a8f-4e98-9867-3aa57544cb34,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4fb93eca989e46cf95bdeec8c513e1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:02Z,use_quota=True,user_id='87ddea9560f740819933ddd37c595ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3f3080-0ed8-46b7-af87-cb6a0ef282d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3f3080-0ed8-46b7-af87-cb6a0ef282d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9e7816-498c-42a3-8680-bf3246691518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9e7816-498c-42a3-8680-bf3246691518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c76f6b9f-3a8f-4e98-9867-3aa57544cb34', 'volume_name': 'volume-c76f6b9f-3a8f-4e98-9867-3aa57544cb34', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc3f2d3-6098-46be-83de-877591dc7836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc3f2d3-6098-46be-83de-877591dc7836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3439c154-6cf2-4085-bb43-4e810207e871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:02 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Volume c76f6b9f-3a8f-4e98-9867-3aa57544cb34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c76f6b9f-3a8f-4e98-9867-3aa57544cb34', 'volume_size': 1} Jul 06 20:53:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-9e53187f-1f93-4c7a-8e4d-4a7e7315a31c req-1c6ac1f8-9f2e-428d-b3ed-fbbd933e6709 tempest-AttachVolumeTestJSON-635946371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:07 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8d77368-19f0-4175-92fa-61bd9f60a6b0" returned: 0 in 5.801s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:08 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9d2977-e3a0-4fb1-968b-03b5f457dace]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:08 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 Jul 06 20:53:08 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:08 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2" returned: 0 in 0.934s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:08 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Image conversion details: src /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8d77368-19f0-4175-92fa-61bd9f60a6b0 {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 20:53:08 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Converted 1024.00 MB image at 176.49 MB/s Jul 06 20:53:08 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8d77368-19f0-4175-92fa-61bd9f60a6b0 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 20:53:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8d77368-19f0-4175-92fa-61bd9f60a6b0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:08 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8d77368-19f0-4175-92fa-61bd9f60a6b0 Jul 06 20:53:08 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:09 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8d77368-19f0-4175-92fa-61bd9f60a6b0" returned: 0 in 0.606s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:09 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-c8d77368-19f0-4175-92fa-61bd9f60a6b0" released by "_copy_volume_from_snapshot" :: held 9.867s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:09 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-901d17f9-4423-4213-99bc-4423753688ca-c8d77368-19f0-4175-92fa-61bd9f60a6b0" released by "_create_volume_from_snapshot" :: held 9.941s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.985s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.925s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1728345265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76f6b9f-3a8f-4e98-9867-3aa57544cb34,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4fb93eca989e46cf95bdeec8c513e1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:02Z,use_quota=True,user_id='87ddea9560f740819933ddd37c595ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:53:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Creating volume c76f6b9f-3a8f-4e98-9867-3aa57544cb34 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:53:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:53:09 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:53:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c76f6b9f-3a8f-4e98-9867-3aa57544cb34 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:09 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c76f6b9f-3a8f-4e98-9867-3aa57544cb34 1073741824 Jul 06 20:53:09 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:09 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-513a5122-fd03-4506-9251-fc9c58c1a1ec tempest-GroupSnapshotsTest-1634452977 None] Create group from source-snapshot-39a77489-09a4-46b0-ab57-73445d687422 completed successfully. Jul 06 20:53:10 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c76f6b9f-3a8f-4e98-9867-3aa57544cb34 1073741824" returned: 0 in 0.797s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c76f6b9f-3a8f-4e98-9867-3aa57544cb34 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:10 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c76f6b9f-3a8f-4e98-9867-3aa57544cb34 Jul 06 20:53:10 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:11 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c76f6b9f-3a8f-4e98-9867-3aa57544cb34" returned: 0 in 0.623s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:53:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-9e53187f-1f93-4c7a-8e4d-4a7e7315a31c req-1c6ac1f8-9f2e-428d-b3ed-fbbd933e6709 tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.864s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3439c154-6cf2-4085-bb43-4e810207e871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c76f6b9f-3a8f-4e98-9867-3aa57544cb34', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cea3c9b-4b0b-4701-971a-111156ba4fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:11 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1684bf9-d4fb-46a6-8020-52bf4c242be5]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-9e53187f-1f93-4c7a-8e4d-4a7e7315a31c req-1c6ac1f8-9f2e-428d-b3ed-fbbd933e6709 tempest-AttachVolumeTestJSON-635946371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:11 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Volume volume-c76f6b9f-3a8f-4e98-9867-3aa57544cb34 (c76f6b9f-3a8f-4e98-9867-3aa57544cb34): created successfully Jul 06 20:53:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cea3c9b-4b0b-4701-971a-111156ba4fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Flow 'volume_create_manager' (adb3970a-9eb2-42f4-b1dc-680d38c8259a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:53:11 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-02344ce3-1fa1-47ff-b9dd-89c8316337f5 tempest-VolumesGetTest-105560451 None] Created volume successfully. Jul 06 20:53:11 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef Jul 06 20:53:11 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "cinder-quobyte-c8d77368-19f0-4175-92fa-61bd9f60a6b0" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-c8d77368-19f0-4175-92fa-61bd9f60a6b0" acquired by "delete_volume" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:11 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd790fb2-1efe-48fd-b74e-527c97f6eaed]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8d77368-19f0-4175-92fa-61bd9f60a6b0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:11 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8d77368-19f0-4175-92fa-61bd9f60a6b0 Jul 06 20:53:11 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:11 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-9e53187f-1f93-4c7a-8e4d-4a7e7315a31c req-1c6ac1f8-9f2e-428d-b3ed-fbbd933e6709 tempest-AttachVolumeTestJSON-635946371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef" returned: 0 in 0.759s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-9e53187f-1f93-4c7a-8e4d-4a7e7315a31c req-1c6ac1f8-9f2e-428d-b3ed-fbbd933e6709 tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.791s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-9e53187f-1f93-4c7a-8e4d-4a7e7315a31c req-1c6ac1f8-9f2e-428d-b3ed-fbbd933e6709 tempest-AttachVolumeTestJSON-635946371 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed71eefc-73c7-49fa-9371-9e3a0ffc0e6a', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 20:53:11 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-9e53187f-1f93-4c7a-8e4d-4a7e7315a31c req-1c6ac1f8-9f2e-428d-b3ed-fbbd933e6709 tempest-AttachVolumeTestJSON-635946371 None] attachment_update completed successfully. Jul 06 20:53:12 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8d77368-19f0-4175-92fa-61bd9f60a6b0" returned: 0 in 0.848s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8d77368-19f0-4175-92fa-61bd9f60a6b0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:12 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8d77368-19f0-4175-92fa-61bd9f60a6b0 Jul 06 20:53:12 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:12 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Flow 'volume_create_manager' (5b474b68-4b57-4ed9-87e4-04428a94a52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07fcb5a9-b452-4656-b193-291d0de57493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07fcb5a9-b452-4656-b193-291d0de57493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:53:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-941090258',display_name='tempest-VolumesGetTest-Volume-942064675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e56aee1-0d85-475b-aef7-db6a1782220e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb93eca989e46cf95bdeec8c513e1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:13Z,use_quota=True,user_id='87ddea9560f740819933ddd37c595ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efca5a1d-ed77-42cb-948c-bc2f6e51f98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efca5a1d-ed77-42cb-948c-bc2f6e51f98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:13 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2858ed21-6821-46ea-901f-89062094fb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2858ed21-6821-46ea-901f-89062094fb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e56aee1-0d85-475b-aef7-db6a1782220e', 'volume_name': 'volume-5e56aee1-0d85-475b-aef7-db6a1782220e', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45bdbf9a-8696-4eca-b03f-6bf3bd1687bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45bdbf9a-8696-4eca-b03f-6bf3bd1687bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ddde528-275a-4ded-9d28-4d6814c4c280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:13 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Volume 5e56aee1-0d85-475b-aef7-db6a1782220e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e56aee1-0d85-475b-aef7-db6a1782220e', 'volume_size': 1} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:53:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-941090258',display_name='tempest-VolumesGetTest-Volume-942064675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e56aee1-0d85-475b-aef7-db6a1782220e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb93eca989e46cf95bdeec8c513e1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:13Z,use_quota=True,user_id='87ddea9560f740819933ddd37c595ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Creating volume 5e56aee1-0d85-475b-aef7-db6a1782220e {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:53:13 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5e56aee1-0d85-475b-aef7-db6a1782220e 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8d77368-19f0-4175-92fa-61bd9f60a6b0" returned: 0 in 0.860s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-c8d77368-19f0-4175-92fa-61bd9f60a6b0" released by "delete_volume" :: held 1.763s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:13 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5e56aee1-0d85-475b-aef7-db6a1782220e 1073741824 Jul 06 20:53:13 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] Created reservations ['dd05eff8-626a-4b30-b711-2779d0cab752'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:53:13 devstack cinder-volume[87207]: WARNING cinder.quota [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-550987584 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-550987584, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:53:13 devstack cinder-volume[87207]: WARNING cinder.quota [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-550987584 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-550987584, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] Created reservations ['941ffedb-bc32-4ff6-aaaf-5201c0fa1bb3', 'c2dadc59-4a35-4d84-af1f-5e2fe5478152', '9b363860-e9c9-420e-9969-5844ad6c9002', '0025c145-4026-491d-b2eb-74e7cc0a3740'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:13 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:53:13 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:13 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] group_snapshot 39a77489-09a4-46b0-ab57-73445d687422: deleting Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] group_snapshot 39a77489-09a4-46b0-ab57-73445d687422: deleting {{(pid=87207) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "cinder-quobyte-99c12357-e718-488b-906b-dabdb49bd8a2" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-99c12357-e718-488b-906b-dabdb49bd8a2" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:13 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "cinder-quobyte-901d17f9-4423-4213-99bc-4423753688ca" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-901d17f9-4423-4213-99bc-4423753688ca" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] Deleting offline snapshot 901d17f9-4423-4213-99bc-4423753688ca of volume 99c12357-e718-488b-906b-dabdb49bd8a2 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:53:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] snapshot_file for this snap is: volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:53:14 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dc11f9-0085-4bbf-9dd4-fb84a793e495]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:14 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.825s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:14 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:53:14 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-8e2c7e6e-a707-4f92-8013-9066c39558b8 tempest-GroupSnapshotsTest-1634452977 None] Delete group completed successfully. Jul 06 20:53:14 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca Jul 06 20:53:14 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:14 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5e56aee1-0d85-475b-aef7-db6a1782220e 1073741824" returned: 0 in 1.245s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5e56aee1-0d85-475b-aef7-db6a1782220e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:14 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5e56aee1-0d85-475b-aef7-db6a1782220e Jul 06 20:53:14 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:14 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca" returned: 0 in 0.864s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99c12357-e718-488b-906b-dabdb49bd8a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:53:14 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec7b0ac-0d4b-4028-91d1-f830520bfa7d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:15 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 Jul 06 20:53:15 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:15 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5e56aee1-0d85-475b-aef7-db6a1782220e" returned: 0 in 0.764s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] <== create_volume: return (2061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:53:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ddde528-275a-4ded-9d28-4d6814c4c280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e56aee1-0d85-475b-aef7-db6a1782220e', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d931c9-9817-4c71-bf6f-89304b8ef1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:15 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Volume volume-5e56aee1-0d85-475b-aef7-db6a1782220e (5e56aee1-0d85-475b-aef7-db6a1782220e): created successfully Jul 06 20:53:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d931c9-9817-4c71-bf6f-89304b8ef1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Flow 'volume_create_manager' (5b474b68-4b57-4ed9-87e4-04428a94a52c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:53:15 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-cf24fa5e-ef64-47db-9e20-29e599f19d01 tempest-VolumesGetTest-105560451 None] Created volume successfully. Jul 06 20:53:15 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2" returned: 0 in 0.867s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:15 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca Jul 06 20:53:15 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:16 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] Acquiring lock "cinder-5e56aee1-0d85-475b-aef7-db6a1782220e-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:16 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] Lock "cinder-5e56aee1-0d85-475b-aef7-db6a1782220e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:16 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] Acquiring lock "cinder-quobyte-5e56aee1-0d85-475b-aef7-db6a1782220e" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:16 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] Lock "cinder-quobyte-5e56aee1-0d85-475b-aef7-db6a1782220e" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:16 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[006e9f5c-85a6-4f48-9656-40e7bf0e2abd]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5e56aee1-0d85-475b-aef7-db6a1782220e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:16 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5e56aee1-0d85-475b-aef7-db6a1782220e Jul 06 20:53:16 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:16 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca" returned: 0 in 0.764s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:16 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca Jul 06 20:53:16 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:17 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5e56aee1-0d85-475b-aef7-db6a1782220e" returned: 0 in 0.897s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5e56aee1-0d85-475b-aef7-db6a1782220e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:17 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2.901d17f9-4423-4213-99bc-4423753688ca" returned: 0 in 0.643s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:17 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5e56aee1-0d85-475b-aef7-db6a1782220e Jul 06 20:53:17 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-901d17f9-4423-4213-99bc-4423753688ca" released by "_delete_snapshot" :: held 3.274s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-99c12357-e718-488b-906b-dabdb49bd8a2" released by "delete_snapshot" :: held 3.312s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:17 devstack cinder-volume[87207]: WARNING cinder.quota [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-550987584 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-550987584, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:53:17 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] Created reservations ['755cc666-a313-4c62-8c77-126f0d127a63', '128b163d-6f95-4876-bd9b-7e3f4a501b1a', '7a8abd1e-c815-4674-96d7-c17b40d0b7e1', '04a34682-f6a7-43ac-8bac-726fe4555c91'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:53:17 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-312a86a5-912a-4db4-b213-68db19cc253d tempest-GroupSnapshotsTest-1634452977 None] group_snapshot 39a77489-09a4-46b0-ab57-73445d687422: deleted successfully Jul 06 20:53:17 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5e56aee1-0d85-475b-aef7-db6a1782220e" returned: 0 in 0.699s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] Lock "cinder-quobyte-5e56aee1-0d85-475b-aef7-db6a1782220e" released by "delete_volume" :: held 1.633s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:17 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] Created reservations ['17c458f1-8da1-4090-aaea-b2f6098bf54e', '9bcd7cd7-ffb8-4e89-b6a9-e6afbfd098c5', 'd05565ea-29ba-4237-a413-5d34c60b45d8', '8e576e84-b98a-4d2f-95d3-d674132fbb99'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:53:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:18 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:53:18 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:18 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-7fe63458-400f-4935-b3fb-9af36f52c415 req-b3d02830-b85f-42a7-abf0-8b5c952c48fa tempest-AttachVolumeTestJSON-635946371 None] Terminate volume connection completed successfully. Jul 06 20:53:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-7fe63458-400f-4935-b3fb-9af36f52c415 req-b3d02830-b85f-42a7-abf0-8b5c952c48fa tempest-AttachVolumeTestJSON-635946371 None] Deleting attachment 67d0178f-d9b1-4673-a92f-52e92660f930. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 20:53:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "cinder-quobyte-99c12357-e718-488b-906b-dabdb49bd8a2" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-99c12357-e718-488b-906b-dabdb49bd8a2" acquired by "delete_volume" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:18 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c3e884-1392-4ac3-9f18-a5f3126c1cb6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:18 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.686s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:18 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:53:18 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] Deleted volume successfully. Jul 06 20:53:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2e5bbe36-f78c-4fbc-8226-3e9f45a06f34 tempest-VolumesGetTest-105560451 None] Lock "cinder-5e56aee1-0d85-475b-aef7-db6a1782220e-delete_volume" released by "delete_volume" :: held 2.528s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:18 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 Jul 06 20:53:18 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] Acquiring lock "cinder-c76f6b9f-3a8f-4e98-9867-3aa57544cb34-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] Lock "cinder-c76f6b9f-3a8f-4e98-9867-3aa57544cb34-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] Acquiring lock "cinder-quobyte-c76f6b9f-3a8f-4e98-9867-3aa57544cb34" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] Lock "cinder-quobyte-c76f6b9f-3a8f-4e98-9867-3aa57544cb34" acquired by "delete_volume" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:19 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2759440-3f21-4ca5-9a4e-cc626cdf3157]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c76f6b9f-3a8f-4e98-9867-3aa57544cb34 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:19 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c76f6b9f-3a8f-4e98-9867-3aa57544cb34 Jul 06 20:53:19 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:19 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2" returned: 0 in 0.877s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:19 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2 Jul 06 20:53:19 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:19 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c76f6b9f-3a8f-4e98-9867-3aa57544cb34" returned: 0 in 0.833s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c76f6b9f-3a8f-4e98-9867-3aa57544cb34 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:19 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c76f6b9f-3a8f-4e98-9867-3aa57544cb34 Jul 06 20:53:19 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:20 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-99c12357-e718-488b-906b-dabdb49bd8a2" returned: 0 in 0.705s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-99c12357-e718-488b-906b-dabdb49bd8a2" released by "delete_volume" :: held 1.659s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] Created reservations ['ad5337ff-216b-4adb-8659-3e6eb4c09060'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:53:20 devstack cinder-volume[87207]: WARNING cinder.db.api [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-550987584'] Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] Created reservations ['3765d726-fd70-40e9-9144-f56d03566a77', '692c452f-5030-4b8f-aed3-21f24b999a92', '6d5b8a6f-084d-4eff-ad0b-d0b3a96f7a71', '9ccbf029-a8ae-4148-8bc0-8a6b052e00c0'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:53:20 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c76f6b9f-3a8f-4e98-9867-3aa57544cb34" returned: 0 in 0.730s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] Lock "cinder-quobyte-c76f6b9f-3a8f-4e98-9867-3aa57544cb34" released by "delete_volume" :: held 1.621s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:20 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:53:20 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] Created reservations ['6a616f16-b87e-4b68-8db7-044b397bd385', '576d2bb8-9038-4a8b-99bd-184af388c89f', '72ddf118-feb5-4a23-b159-b7fa1964d27f', 'bb2f5260-eac2-4643-8dc5-db8a1906f8b3'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:20 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:53:20 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:20 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-247c529b-c877-413c-8635-235c1bcd5b9f req-6537b547-4032-4764-b509-4d4057f0192f tempest-AttachVolumeTestJSON-635946371 None] Terminate volume connection completed successfully. Jul 06 20:53:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-247c529b-c877-413c-8635-235c1bcd5b9f req-6537b547-4032-4764-b509-4d4057f0192f tempest-AttachVolumeTestJSON-635946371 None] Deleting attachment ed71eefc-73c7-49fa-9371-9e3a0ffc0e6a. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 20:53:21 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.780s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:53:21 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-6cdcfcdc-43cd-4788-b236-ef287a60ab92 tempest-GroupSnapshotsTest-1634452977 None] Delete group completed successfully. Jul 06 20:53:21 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.714s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:53:21 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] Deleted volume successfully. Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bdcd2795-4889-4eb8-9fa9-cdef22e9cffe tempest-VolumesGetTest-105560451 None] Lock "cinder-c76f6b9f-3a8f-4e98-9867-3aa57544cb34-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Flow 'volume_create_manager' (0fadac7f-dd06-480d-918f-44056278614c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e099b0ed-fab4-45d3-8324-fe9e64791caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e099b0ed-fab4-45d3-8324-fe9e64791caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-706559654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb93eca989e46cf95bdeec8c513e1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:22Z,use_quota=True,user_id='87ddea9560f740819933ddd37c595ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79dee0bd-4d5b-47dc-813b-76aec1b2b9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79dee0bd-4d5b-47dc-813b-76aec1b2b9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074d1b94-7a99-4e54-b483-c7a73819d331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074d1b94-7a99-4e54-b483-c7a73819d331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe', 'volume_name': 'volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72af43e3-b903-4496-b36e-de7c72ac7d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72af43e3-b903-4496-b36e-de7c72ac7d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17688ba0-2c41-498c-b543-8bed8457db5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:21 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Volume f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe', 'volume_size': 1} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-706559654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb93eca989e46cf95bdeec8c513e1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:22Z,use_quota=True,user_id='87ddea9560f740819933ddd37c595ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Creating volume f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:53:21 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:53:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:21 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-2fdbf60d-55dc-4ed5-be5d-fb58d2190530 tempest-GroupSnapshotsTest-1634452977 None] Group tempest-GroupSnapshotsTest-Group-201882445: creating Jul 06 20:53:21 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe 1073741824 Jul 06 20:53:21 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:21 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-2fdbf60d-55dc-4ed5-be5d-fb58d2190530 tempest-GroupSnapshotsTest-1634452977 None] Group tempest-GroupSnapshotsTest-Group-201882445: created successfully Jul 06 20:53:21 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-2fdbf60d-55dc-4ed5-be5d-fb58d2190530 tempest-GroupSnapshotsTest-1634452977 None] Create group completed successfully. Jul 06 20:53:22 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe 1073741824" returned: 0 in 0.880s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:22 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe Jul 06 20:53:22 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Flow 'volume_create_manager' (f7f7c45e-9db5-418f-bb66-c9a8567608fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1210e788-bc40-40ad-85dd-06f23c3d10ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1210e788-bc40-40ad-85dd-06f23c3d10ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-953022261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5301c811-6efb-4879-a5c1-3669fc95f9ea,host='devstack@QuobyteHD#QuobyteHD',id=bb0000fa-132a-4bce-aa40-656fcbbb3f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85478e6cf691404d8f4e6b3c9736a9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:24Z,use_quota=True,user_id='dbe258cbe9a24a428f1db480ccd86c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d7df555-67a9-4f73-8c26-0963ac945651),volume_type_id=1d7df555-67a9-4f73-8c26-0963ac945651)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf3aad1-f3b6-4b1f-8a51-55bdb8fb98fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf3aad1-f3b6-4b1f-8a51-55bdb8fb98fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa2fd98-0be3-42b3-a050-2b57cae30ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa2fd98-0be3-42b3-a050-2b57cae30ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb0000fa-132a-4bce-aa40-656fcbbb3f2e', 'volume_name': 'volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3835b20f-35e5-42df-980f-f07cc19f69cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3835b20f-35e5-42df-980f-f07cc19f69cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3d4a08-e954-43ac-977f-efce286fdff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:23 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Volume bb0000fa-132a-4bce-aa40-656fcbbb3f2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e', 'volume_size': 1} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-f42d9b1e-d7c0-4b68-b29a-ae6c887dd327 req-7e4dc082-178b-4ec9-aa0e-d0a6cbdaaf7a tempest-TestInstancesWithCinderVolumes-1294367857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:23 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe" returned: 0 in 0.920s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.044s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5301c811-6efb-4879-a5c1-3669fc95f9ea,created_at=2026-07-06T18:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-953022261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5301c811-6efb-4879-a5c1-3669fc95f9ea,host='devstack@QuobyteHD#QuobyteHD',id=bb0000fa-132a-4bce-aa40-656fcbbb3f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85478e6cf691404d8f4e6b3c9736a9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:24Z,use_quota=True,user_id='dbe258cbe9a24a428f1db480ccd86c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d7df555-67a9-4f73-8c26-0963ac945651),volume_type_id=1d7df555-67a9-4f73-8c26-0963ac945651)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Creating volume bb0000fa-132a-4bce-aa40-656fcbbb3f2e {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:53:23 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:23 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e 1073741824 Jul 06 20:53:23 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17688ba0-2c41-498c-b543-8bed8457db5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ef61bd6-de27-4b22-8e59-d1662d108f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:23 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Volume volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe (f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe): created successfully Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ef61bd6-de27-4b22-8e59-d1662d108f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Flow 'volume_create_manager' (0fadac7f-dd06-480d-918f-44056278614c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:53:23 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-394b82b6-2147-4caf-a54b-c568c6e9d34a tempest-VolumesGetTest-105560451 None] Created volume successfully. Jul 06 20:53:24 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e 1073741824" returned: 0 in 0.818s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:24 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e Jul 06 20:53:24 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:25 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e" returned: 0 in 0.854s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-f42d9b1e-d7c0-4b68-b29a-ae6c887dd327 req-7e4dc082-178b-4ec9-aa0e-d0a6cbdaaf7a tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.745s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3d4a08-e954-43ac-977f-efce286fdff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be5880ef-916c-40ad-8234-0717b949b074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2183134b-86b8-4aab-bcdb-20f53009b54c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-f42d9b1e-d7c0-4b68-b29a-ae6c887dd327 req-7e4dc082-178b-4ec9-aa0e-d0a6cbdaaf7a tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:25 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Volume volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e (bb0000fa-132a-4bce-aa40-656fcbbb3f2e): created successfully Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be5880ef-916c-40ad-8234-0717b949b074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Flow 'volume_create_manager' (f7f7c45e-9db5-418f-bb66-c9a8567608fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:53:25 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-30d1f9a8-05b6-4a34-a642-5c89d5dcf942 tempest-GroupSnapshotsTest-1634452977 None] Created volume successfully. Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Flow 'volume_create_manager' (4ab011e1-e059-4de0-8847-35454519ee37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08e8f06-eaba-4aa9-aec2-f796858f1083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08e8f06-eaba-4aa9-aec2-f796858f1083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-560590330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184591d8-a75f-4dc6-a7ab-7569423f1ccd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4fb93eca989e46cf95bdeec8c513e1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:26Z,use_quota=True,user_id='87ddea9560f740819933ddd37c595ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:25 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a Jul 06 20:53:25 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21738cd-57f1-45d3-8d9d-985928ea7df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21738cd-57f1-45d3-8d9d-985928ea7df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e216d15-6806-4cf8-8c65-f477a63e3f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e216d15-6806-4cf8-8c65-f477a63e3f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '184591d8-a75f-4dc6-a7ab-7569423f1ccd', 'volume_name': 'volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd', 'volume_size': 1, 'source_volid': 'f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe', 'source_volstatus': 'available'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d13e04-9a1b-4bf1-a71c-3bbf39837207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d13e04-9a1b-4bf1-a71c-3bbf39837207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612c71f9-45b3-4021-8e61-3227e656e5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:25 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Volume 184591d8-a75f-4dc6-a7ab-7569423f1ccd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd', 'volume_size': 1, 'source_volid': 'f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe', 'source_volstatus': 'available'} Jul 06 20:53:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:26 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-f42d9b1e-d7c0-4b68-b29a-ae6c887dd327 req-7e4dc082-178b-4ec9-aa0e-d0a6cbdaaf7a tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a" returned: 0 in 0.891s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-f42d9b1e-d7c0-4b68-b29a-ae6c887dd327 req-7e4dc082-178b-4ec9-aa0e-d0a6cbdaaf7a tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.921s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.693s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:26 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Cloning volume f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe to volume 184591d8-a75f-4dc6-a7ab-7569423f1ccd Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Creating offline snapshot 3891947e-f783-472b-a8b5-46e6828ef5de of volume f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-f42d9b1e-d7c0-4b68-b29a-ae6c887dd327 req-7e4dc082-178b-4ec9-aa0e-d0a6cbdaaf7a tempest-TestInstancesWithCinderVolumes-1294367857 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'acaa7a0d-279e-401c-ba2c-193d496f7add', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ce9c32-fe87-43c5-a979-38d87fa89b2d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Flow 'volume_create_manager' (0f096667-c8dc-46f2-9c73-5b48760a87d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1892e63b-57be-430d-b333-2870c03cd513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:26 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe Jul 06 20:53:26 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:26 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-f42d9b1e-d7c0-4b68-b29a-ae6c887dd327 req-7e4dc082-178b-4ec9-aa0e-d0a6cbdaaf7a tempest-TestInstancesWithCinderVolumes-1294367857 None] attachment_update completed successfully. Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1892e63b-57be-430d-b333-2870c03cd513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1027911004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5301c811-6efb-4879-a5c1-3669fc95f9ea,host='devstack@QuobyteHD#QuobyteHD',id=1b531682-a907-4f35-910b-05433ea41c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85478e6cf691404d8f4e6b3c9736a9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:27Z,use_quota=True,user_id='dbe258cbe9a24a428f1db480ccd86c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d7df555-67a9-4f73-8c26-0963ac945651),volume_type_id=1d7df555-67a9-4f73-8c26-0963ac945651)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bf8f6d-bc9d-46b3-b7b0-84069ec59023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bf8f6d-bc9d-46b3-b7b0-84069ec59023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef086b2-1b65-4709-8c5a-af8bf88373b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef086b2-1b65-4709-8c5a-af8bf88373b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b531682-a907-4f35-910b-05433ea41c1d', 'volume_name': 'volume-1b531682-a907-4f35-910b-05433ea41c1d', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d998e491-4d68-48ab-be9c-62dd9678c455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d998e491-4d68-48ab-be9c-62dd9678c455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e222bd02-878b-4abf-9257-e3dcffcc3a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:26 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Volume 1b531682-a907-4f35-910b-05433ea41c1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b531682-a907-4f35-910b-05433ea41c1d', 'volume_size': 1} Jul 06 20:53:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:27 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe" returned: 0 in 0.967s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:27 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de 1G Jul 06 20:53:27 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:28 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de 1G" returned: 0 in 0.808s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:28 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de Jul 06 20:53:28 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:28 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de" returned: 0 in 0.682s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:28 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de is being set with open permissions: ugo+rw Jul 06 20:53:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:28 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de Jul 06 20:53:28 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:29 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de" returned: 0 in 0.638s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:29 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.info Jul 06 20:53:29 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:30 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.info" returned: 0 in 0.672s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:30 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.info is being set with open permissions: ugo+rw Jul 06 20:53:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:30 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.info Jul 06 20:53:30 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:30 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.info" returned: 0 in 0.634s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:30 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Acquiring lock "cinder-quobyte-184591d8-a75f-4dc6-a7ab-7569423f1ccd" by "_copy_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:30 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Lock "cinder-quobyte-184591d8-a75f-4dc6-a7ab-7569423f1ccd" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] snapshot: 3891947e-f783-472b-a8b5-46e6828ef5de, volume: 184591d8-a75f-4dc6-a7ab-7569423f1ccd, {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 20:53:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:31 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d875b082-42b2-499e-a08d-d47d392cf5b2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:31 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de Jul 06 20:53:31 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:31 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de" returned: 0 in 0.897s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:53:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 20:53:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Creating direct copy from snapshot {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 20:53:31 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df89337-b2d8-4af1-890a-8a76dddb5d22]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] Acquiring lock "cinder-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] Lock "cinder-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:32 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe Jul 06 20:53:32 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] Acquiring lock "cinder-quobyte-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] Lock "cinder-quobyte-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef" acquired by "delete_volume" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:32 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacca37d-6dfe-4d9d-8961-16d1c4153d43]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:32 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef Jul 06 20:53:32 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:32 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe" returned: 0 in 0.814s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:32 devstack cinder-volume[87207]: DEBUG cinder.utils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Path /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd not found in is_blk_device check {{(pid=87207) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 20:53:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:32 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd Jul 06 20:53:32 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:32 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef" returned: 0 in 0.787s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:32 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef Jul 06 20:53:32 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:33 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef" returned: 0 in 0.688s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] Lock "cinder-quobyte-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef" released by "delete_volume" :: held 1.545s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:33 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] Created reservations ['eb044a0a-beff-42c9-ad2a-294e68c37619', '98137d5f-2f42-4364-bf4e-ef8e57ab0d50', '6c9ee2c5-b830-434c-b4a4-afbcb7f71dd6', '739630f3-4897-4a25-843c-072fbd53e9c1'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:53:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:34 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:53:34 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] Acquiring lock "cinder-62ddc295-3b77-4a81-baed-928462dac744-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] Lock "cinder-62ddc295-3b77-4a81-baed-928462dac744-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] Acquiring lock "cinder-quobyte-62ddc295-3b77-4a81-baed-928462dac744" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] Lock "cinder-quobyte-62ddc295-3b77-4a81-baed-928462dac744" acquired by "delete_volume" :: waited 0.043s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:34 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8253f05-d8b3-4f42-9f22-841192c671a2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62ddc295-3b77-4a81-baed-928462dac744 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:35 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62ddc295-3b77-4a81-baed-928462dac744 Jul 06 20:53:35 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-84f7ef34-3559-4233-a76f-2e6d6e9e90a0 req-a18d204b-d457-4a33-83ca-1b6796f56ecb tempest-TestInstancesWithCinderVolumes-1294367857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:35 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.672s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:35 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:53:35 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] Deleted volume successfully. Jul 06 20:53:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-4442c2dc-4b38-4532-8bc2-01bed5dc1ba2 tempest-AttachVolumeTestJSON-635946371 None] Lock "cinder-e0f63bf4-103a-4557-af9d-ac8ff5ebdeef-delete_volume" released by "delete_volume" :: held 3.787s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:36 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62ddc295-3b77-4a81-baed-928462dac744" returned: 0 in 1.632s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62ddc295-3b77-4a81-baed-928462dac744 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:36 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62ddc295-3b77-4a81-baed-928462dac744 Jul 06 20:53:36 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:37 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62ddc295-3b77-4a81-baed-928462dac744" returned: 0 in 1.262s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:37 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] Lock "cinder-quobyte-62ddc295-3b77-4a81-baed-928462dac744" released by "delete_volume" :: held 2.985s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:37 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] Created reservations ['519451b1-f981-4ddb-aeaf-be00256a75cd', '0e00be52-8486-464a-bf0f-2b5a276f167a', '6b2579c9-f3d6-4dac-a2be-4f484c918b0d', '54eef926-c8ed-45a8-a250-f379f8cd3655'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:53:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:37 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:37 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:37 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:53:37 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:38 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd" returned: 0 in 5.649s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:38 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[778e52df-9542-4c45-b372-c07dd1e42d32]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] Acquiring lock "cinder-20fc10e2-9fcc-422e-9681-799bada5a26f-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] Lock "cinder-20fc10e2-9fcc-422e-9681-799bada5a26f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] Acquiring lock "cinder-quobyte-20fc10e2-9fcc-422e-9681-799bada5a26f" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] Lock "cinder-quobyte-20fc10e2-9fcc-422e-9681-799bada5a26f" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:38 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a1fed2-feae-4ae1-9ee0-0682a4026260]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-20fc10e2-9fcc-422e-9681-799bada5a26f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:38 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe Jul 06 20:53:38 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:38 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-20fc10e2-9fcc-422e-9681-799bada5a26f Jul 06 20:53:38 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:38 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.871s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:38 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:53:38 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] Deleted volume successfully. Jul 06 20:53:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-44d9c3ae-57ca-4b3b-8a64-cc1cda53fdb5 tempest-AttachVolumeTestJSON-635946371 None] Lock "cinder-62ddc295-3b77-4a81-baed-928462dac744-delete_volume" released by "delete_volume" :: held 4.315s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:39 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-20fc10e2-9fcc-422e-9681-799bada5a26f" returned: 0 in 0.845s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-20fc10e2-9fcc-422e-9681-799bada5a26f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:39 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-20fc10e2-9fcc-422e-9681-799bada5a26f Jul 06 20:53:39 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:39 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe" returned: 0 in 0.995s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:39 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Image conversion details: src /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 20:53:39 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Converted 1024.00 MB image at 181.21 MB/s Jul 06 20:53:39 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd is being set with open permissions: ugo+rw Jul 06 20:53:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:39 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd Jul 06 20:53:39 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:40 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-20fc10e2-9fcc-422e-9681-799bada5a26f" returned: 0 in 0.643s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] Lock "cinder-quobyte-20fc10e2-9fcc-422e-9681-799bada5a26f" released by "delete_volume" :: held 1.527s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:40 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] Created reservations ['22826be3-f20d-4b3a-8527-733849f5cd81', 'b5fc1645-d4b1-4268-a156-d784467a2782', 'd7be23fc-19ba-4a65-95c3-988d5656de6c', '3185762b-e8c6-4276-820a-17161a154b84'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd" returned: 0 in 0.672s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Lock "cinder-quobyte-184591d8-a75f-4dc6-a7ab-7569423f1ccd" released by "_copy_volume_from_snapshot" :: held 9.130s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Acquiring lock "cinder-quobyte-3891947e-f783-472b-a8b5-46e6828ef5de" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Lock "cinder-quobyte-3891947e-f783-472b-a8b5-46e6828ef5de" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Deleting offline snapshot 3891947e-f783-472b-a8b5-46e6828ef5de of volume f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] snapshot_file for this snap is: volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecb2814-78d6-4927-83f7-a222f1d790dc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:40 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:53:40 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:40 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de Jul 06 20:53:40 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:40 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.645s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:53:40 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] Deleted volume successfully. Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1dbbe666-f9a9-4c61-be26-397dbbe246b0 tempest-AttachVolumeTestJSON-635946371 None] Lock "cinder-20fc10e2-9fcc-422e-9681-799bada5a26f-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:40 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de" returned: 0 in 0.798s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:53:41 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96f6a94-6cd0-4749-8402-2736665bd2c3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:41 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe Jul 06 20:53:41 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:41 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe" returned: 0 in 0.889s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:41 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de Jul 06 20:53:41 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:42 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de" returned: 0 in 0.786s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:42 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de Jul 06 20:53:42 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:43 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe.3891947e-f783-472b-a8b5-46e6828ef5de" returned: 0 in 0.677s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Lock "cinder-quobyte-3891947e-f783-472b-a8b5-46e6828ef5de" released by "_delete_snapshot" :: held 3.252s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=106,cinder:UPDATE=99,cinder:INSERT=30,cinder:DELETE=6 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=108,cinder:UPDATE=120,cinder:DELETE=7,cinder:INSERT=18 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.027s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.681s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5301c811-6efb-4879-a5c1-3669fc95f9ea,created_at=2026-07-06T18:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1027911004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5301c811-6efb-4879-a5c1-3669fc95f9ea,host='devstack@QuobyteHD#QuobyteHD',id=1b531682-a907-4f35-910b-05433ea41c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85478e6cf691404d8f4e6b3c9736a9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:27Z,use_quota=True,user_id='dbe258cbe9a24a428f1db480ccd86c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d7df555-67a9-4f73-8c26-0963ac945651),volume_type_id=1d7df555-67a9-4f73-8c26-0963ac945651)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Creating volume 1b531682-a907-4f35-910b-05433ea41c1d {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:53:43 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612c71f9-45b3-4021-8e61-3227e656e5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd', 'volume_size': 1, 'source_volid': 'f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe', 'source_volstatus': 'available'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:43 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d 1073741824 Jul 06 20:53:43 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164f2633-1e8e-4192-bc69-2a1edf16199e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:43 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Volume volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd (184591d8-a75f-4dc6-a7ab-7569423f1ccd): created successfully Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164f2633-1e8e-4192-bc69-2a1edf16199e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Flow 'volume_create_manager' (4ab011e1-e059-4de0-8847-35454519ee37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:53:43 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d88c8302-7f58-4d7a-873a-a551efe3fe23 tempest-VolumesGetTest-105560451 None] Created volume successfully. Jul 06 20:53:44 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d 1073741824" returned: 0 in 0.997s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:44 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d Jul 06 20:53:44 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Flow 'volume_create_manager' (19e14ca4-cd40-4f3b-be52-e5a444836dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb51558-2da4-4a7b-9766-c6c5b9831980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb51558-2da4-4a7b-9766-c6c5b9831980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:53:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-275433364',display_name='tempest-VolumesGetTest-Volume-1192620737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47aba623-08ce-464a-b618-06e54a1b51c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb93eca989e46cf95bdeec8c513e1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:45Z,use_quota=True,user_id='87ddea9560f740819933ddd37c595ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe6dcae0-e3ea-4f61-b098-d65d7608f9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe6dcae0-e3ea-4f61-b098-d65d7608f9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7ec896-e2c6-4b9a-a402-7c4f2a938707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7ec896-e2c6-4b9a-a402-7c4f2a938707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47aba623-08ce-464a-b618-06e54a1b51c2', 'volume_name': 'volume-47aba623-08ce-464a-b618-06e54a1b51c2', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd83c7a-baf8-472d-93da-a0b1fb5ef1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd83c7a-baf8-472d-93da-a0b1fb5ef1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1daf53-894c-4cd5-b038-7fbcb761885d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:45 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Volume 47aba623-08ce-464a-b618-06e54a1b51c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47aba623-08ce-464a-b618-06e54a1b51c2', 'volume_size': 1} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:45 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d" returned: 0 in 0.841s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-84f7ef34-3559-4233-a76f-2e6d6e9e90a0 req-a18d204b-d457-4a33-83ca-1b6796f56ecb tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.710s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e222bd02-878b-4abf-9257-e3dcffcc3a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b531682-a907-4f35-910b-05433ea41c1d', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3bad56e-fc14-4899-8a0c-97b054ed28d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1e99c2-db99-4eb5-92bf-41ba3ecebfef]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-84f7ef34-3559-4233-a76f-2e6d6e9e90a0 req-a18d204b-d457-4a33-83ca-1b6796f56ecb tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:45 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Volume volume-1b531682-a907-4f35-910b-05433ea41c1d (1b531682-a907-4f35-910b-05433ea41c1d): created successfully Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3bad56e-fc14-4899-8a0c-97b054ed28d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Flow 'volume_create_manager' (0f096667-c8dc-46f2-9c73-5b48760a87d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:53:45 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-21739ba7-b96a-41fa-95fb-6b3172c9490f tempest-GroupSnapshotsTest-1634452977 None] Created volume successfully. Jul 06 20:53:45 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68 Jul 06 20:53:45 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:46 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-84f7ef34-3559-4233-a76f-2e6d6e9e90a0 req-a18d204b-d457-4a33-83ca-1b6796f56ecb tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68" returned: 0 in 0.800s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-84f7ef34-3559-4233-a76f-2e6d6e9e90a0 req-a18d204b-d457-4a33-83ca-1b6796f56ecb tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.832s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.016s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:53:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-275433364',display_name='tempest-VolumesGetTest-Volume-1192620737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47aba623-08ce-464a-b618-06e54a1b51c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb93eca989e46cf95bdeec8c513e1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:45Z,use_quota=True,user_id='87ddea9560f740819933ddd37c595ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:53:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Creating volume 47aba623-08ce-464a-b618-06e54a1b51c2 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:53:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:53:46 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:53:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-47aba623-08ce-464a-b618-06e54a1b51c2 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:46 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-47aba623-08ce-464a-b618-06e54a1b51c2 1073741824 Jul 06 20:53:46 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-84f7ef34-3559-4233-a76f-2e6d6e9e90a0 req-a18d204b-d457-4a33-83ca-1b6796f56ecb tempest-TestInstancesWithCinderVolumes-1294367857 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0331c607-9f39-4c2a-8f16-b73e5dfe1a27', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 20:53:46 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-84f7ef34-3559-4233-a76f-2e6d6e9e90a0 req-a18d204b-d457-4a33-83ca-1b6796f56ecb tempest-TestInstancesWithCinderVolumes-1294367857 None] attachment_update completed successfully. Jul 06 20:53:46 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-6dc7b23d-807d-4dab-aae5-a25717a82770 tempest-GroupSnapshotsTest-1634452977 None] Update group completed successfully. Jul 06 20:53:47 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-47aba623-08ce-464a-b618-06e54a1b51c2 1073741824" returned: 0 in 1.010s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-47aba623-08ce-464a-b618-06e54a1b51c2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:47 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-47aba623-08ce-464a-b618-06e54a1b51c2 Jul 06 20:53:47 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:47 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f9139c16-0efa-4bfa-a8fb-1cd85780d010 tempest-GroupSnapshotsTest-1634452977 None] Update group completed successfully. Jul 06 20:53:47 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-47aba623-08ce-464a-b618-06e54a1b51c2" returned: 0 in 0.696s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:53:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1daf53-894c-4cd5-b038-7fbcb761885d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47aba623-08ce-464a-b618-06e54a1b51c2', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775c322a-1ca9-48c2-ae4e-8a98ec08cd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:47 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Volume volume-47aba623-08ce-464a-b618-06e54a1b51c2 (47aba623-08ce-464a-b618-06e54a1b51c2): created successfully Jul 06 20:53:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775c322a-1ca9-48c2-ae4e-8a98ec08cd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Flow 'volume_create_manager' (19e14ca4-cd40-4f3b-be52-e5a444836dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:53:47 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-10e069b4-c3ed-4cd9-ae7b-84524f3f039d tempest-VolumesGetTest-105560451 None] Created volume successfully. Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Flow 'volume_create_manager' (c9741e7c-a114-486d-89e0-2fc54df27913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cae59e7-bc49-4e9c-90f7-853d326a9922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cae59e7-bc49-4e9c-90f7-853d326a9922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1262384167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d719d8-eeef-4424-a84a-1245abee7737,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8208197623304962b067a13a9512ec96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:48Z,use_quota=True,user_id='90591f1cfcb349b1b75f2d4896334362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5fdfc10-c25a-4d8c-9c79-d71b9cfc2ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5fdfc10-c25a-4d8c-9c79-d71b9cfc2ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0068740-424b-4483-9299-01f83c60145b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0068740-424b-4483-9299-01f83c60145b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2d719d8-eeef-4424-a84a-1245abee7737', 'volume_name': 'volume-c2d719d8-eeef-4424-a84a-1245abee7737', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec330949-a322-4957-bfa6-fc9a05117746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec330949-a322-4957-bfa6-fc9a05117746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ba5ca9-9e6c-4f03-82c3-3d529e326fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:48 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Volume c2d719d8-eeef-4424-a84a-1245abee7737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2d719d8-eeef-4424-a84a-1245abee7737', 'volume_size': 1} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1262384167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d719d8-eeef-4424-a84a-1245abee7737,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8208197623304962b067a13a9512ec96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:48Z,use_quota=True,user_id='90591f1cfcb349b1b75f2d4896334362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Creating volume c2d719d8-eeef-4424-a84a-1245abee7737 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:53:48 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2d719d8-eeef-4424-a84a-1245abee7737 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] Acquiring lock "cinder-47aba623-08ce-464a-b618-06e54a1b51c2-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:48 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2d719d8-eeef-4424-a84a-1245abee7737 1073741824 Jul 06 20:53:48 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] Lock "cinder-47aba623-08ce-464a-b618-06e54a1b51c2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] Acquiring lock "cinder-quobyte-47aba623-08ce-464a-b618-06e54a1b51c2" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] Lock "cinder-quobyte-47aba623-08ce-464a-b618-06e54a1b51c2" acquired by "delete_volume" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde06626-009a-42d7-b12c-6ce13b21b952]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-47aba623-08ce-464a-b618-06e54a1b51c2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:48 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-47aba623-08ce-464a-b618-06e54a1b51c2 Jul 06 20:53:48 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:48 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-01178d3b-e178-4992-bd5c-0c04d316f4df tempest-GroupSnapshotsTest-1634452977 None] Update group completed successfully. Jul 06 20:53:49 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2d719d8-eeef-4424-a84a-1245abee7737 1073741824" returned: 0 in 0.867s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2d719d8-eeef-4424-a84a-1245abee7737 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:49 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2d719d8-eeef-4424-a84a-1245abee7737 Jul 06 20:53:49 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:49 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-47aba623-08ce-464a-b618-06e54a1b51c2" returned: 0 in 0.866s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-47aba623-08ce-464a-b618-06e54a1b51c2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:49 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-47aba623-08ce-464a-b618-06e54a1b51c2 Jul 06 20:53:49 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:49 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2d719d8-eeef-4424-a84a-1245abee7737" returned: 0 in 0.704s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:53:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:49 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ba5ca9-9e6c-4f03-82c3-3d529e326fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d719d8-eeef-4424-a84a-1245abee7737', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38cd6db3-2265-4d49-af72-ea8b594f39c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-47aba623-08ce-464a-b618-06e54a1b51c2" returned: 0 in 0.664s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] Lock "cinder-quobyte-47aba623-08ce-464a-b618-06e54a1b51c2" released by "delete_volume" :: held 1.580s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:50 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Volume volume-c2d719d8-eeef-4424-a84a-1245abee7737 (c2d719d8-eeef-4424-a84a-1245abee7737): created successfully Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38cd6db3-2265-4d49-af72-ea8b594f39c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Flow 'volume_create_manager' (c9741e7c-a114-486d-89e0-2fc54df27913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:53:50 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-1cbcd5d2-7181-4ed6-b4b0-6238faa62407 req-57ffa56b-94df-47f5-981a-0d4f5a044454 tempest-VolumesGetTestJSON-397258964 None] Created volume successfully. Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] Created reservations ['ca142478-3c2e-4317-ae6e-7f66a4e7996e', 'e4784a5e-ec0b-445b-8fca-69088d8fb20f', '0f64463b-a7bf-49dd-9e75-f24f04294030', 'da682505-f1cd-4353-928f-a2c231fea32b'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:53:50 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-88cf2369-5d8f-46af-9342-e018921a338b tempest-GroupSnapshotsTest-1634452977 None] Update group completed successfully. Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:50 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:53:50 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] Acquiring lock "cinder-c2d719d8-eeef-4424-a84a-1245abee7737-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] Lock "cinder-c2d719d8-eeef-4424-a84a-1245abee7737-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] Acquiring lock "cinder-quobyte-c2d719d8-eeef-4424-a84a-1245abee7737" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] Acquiring lock "cinder-184591d8-a75f-4dc6-a7ab-7569423f1ccd-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] Lock "cinder-quobyte-c2d719d8-eeef-4424-a84a-1245abee7737" acquired by "delete_volume" :: waited 0.037s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] Lock "cinder-184591d8-a75f-4dc6-a7ab-7569423f1ccd-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[db48f210-7a26-4637-9712-2f9bf46c386f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2d719d8-eeef-4424-a84a-1245abee7737 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] Acquiring lock "cinder-quobyte-184591d8-a75f-4dc6-a7ab-7569423f1ccd" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] Lock "cinder-quobyte-184591d8-a75f-4dc6-a7ab-7569423f1ccd" acquired by "delete_volume" :: waited 0.028s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70bfedd-c751-44c1-8374-775fb8614525]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:50 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2d719d8-eeef-4424-a84a-1245abee7737 Jul 06 20:53:50 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:50 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.762s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:50 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:53:50 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] Deleted volume successfully. Jul 06 20:53:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-76acf6fb-694b-4f23-be9a-3ec75c63d854 tempest-VolumesGetTest-105560451 None] Lock "cinder-47aba623-08ce-464a-b618-06e54a1b51c2-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:51 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd Jul 06 20:53:51 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:51 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2d719d8-eeef-4424-a84a-1245abee7737" returned: 0 in 0.929s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2d719d8-eeef-4424-a84a-1245abee7737 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:51 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2d719d8-eeef-4424-a84a-1245abee7737 Jul 06 20:53:51 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:51 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] GroupSnapshot f948ebba-c506-4568-a057-6be96df4e2c4: creating. Jul 06 20:53:51 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd" returned: 0 in 1.049s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Group snapshot f948ebba-c506-4568-a057-6be96df4e2c4: creating. {{(pid=87207) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 20:53:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:51 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd Jul 06 20:53:51 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Creating offline snapshot 5a159654-9475-4d7c-9170-f9a2c06c879a of volume bb0000fa-132a-4bce-aa40-656fcbbb3f2e {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca88320-8692-4703-8b48-e1e4cbc2f2ea]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:52 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e Jul 06 20:53:52 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:52 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2d719d8-eeef-4424-a84a-1245abee7737" returned: 0 in 0.781s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] Lock "cinder-quobyte-c2d719d8-eeef-4424-a84a-1245abee7737" released by "delete_volume" :: held 1.794s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG cinder.quota [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] Created reservations ['d3ff4448-fa76-41c1-99eb-c2c942f8dbd8', 'f0ff2247-8b7c-41a9-a717-25ae319c28ea', 'c020a9ba-9742-4554-9e4a-ab9baec28dd5', '5addb052-6f13-4d99-bde7-d47ac1dff2b7'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:52 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:53:52 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:52 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-184591d8-a75f-4dc6-a7ab-7569423f1ccd" returned: 0 in 0.813s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] Lock "cinder-quobyte-184591d8-a75f-4dc6-a7ab-7569423f1ccd" released by "delete_volume" :: held 1.918s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] Created reservations ['481607b1-48a7-4c4d-b9c1-b72b41df848e', '578c6873-cd02-40ef-b0af-72a4f8de0d6a', '723923c0-397d-4dfb-ab43-2154008559c5', '8a458b24-b37c-4f21-a5a8-5a8feed21e0d'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:53 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:53:53 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:53 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e" returned: 0 in 1.136s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:53 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a 1G Jul 06 20:53:53 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:53 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] Acquiring lock "cinder-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:53 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] Lock "cinder-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:53 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] Acquiring lock "cinder-quobyte-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:53 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] Lock "cinder-quobyte-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe" acquired by "delete_volume" :: waited 0.040s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:53 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1742c13f-6a52-44bc-a373-b2b13c0acb8b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:53 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe Jul 06 20:53:53 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:53 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.063s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:53 devstack cinder-volume[87207]: DEBUG cinder.manager [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:53:53 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] Deleted volume successfully. Jul 06 20:53:53 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-79077446-196f-4371-b66e-3ea64336ba4e req-53fc3ac1-6a35-4eb6-ad46-cbf0951492b1 tempest-VolumesGetTestJSON-397258964 None] Lock "cinder-c2d719d8-eeef-4424-a84a-1245abee7737-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:54 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.172s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:54 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:53:54 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] Deleted volume successfully. Jul 06 20:53:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0ac57d0e-42f4-49ba-88ae-b4705606e93e tempest-VolumesGetTest-105560451 None] Lock "cinder-184591d8-a75f-4dc6-a7ab-7569423f1ccd-delete_volume" released by "delete_volume" :: held 3.451s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:54 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a 1G" returned: 0 in 1.246s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:54 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a Jul 06 20:53:54 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:54 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe" returned: 0 in 1.139s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:54 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe Jul 06 20:53:54 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:55 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a" returned: 0 in 0.874s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:55 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a is being set with open permissions: ugo+rw: NotImplementedError Jul 06 20:53:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:55 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a Jul 06 20:53:55 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:55 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe" returned: 0 in 0.886s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] Lock "cinder-quobyte-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe" released by "delete_volume" :: held 2.145s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:55 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] Created reservations ['778c258d-3eb3-41f3-b857-771498ecba6b', '71d250e9-1f75-48dc-a429-1bbf9b259992', '0d32d969-99ee-48e7-9df8-cb736dac4756', '87beb4ed-45bc-4129-bd69-0949ed6e061d'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:53:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:55 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:53:55 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:55 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a" returned: 0 in 0.698s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:56 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.info Jul 06 20:53:56 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:56 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.803s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:56 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:53:56 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] Deleted volume successfully. Jul 06 20:53:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0e50a771-40db-4024-ab22-984e0f0d46a7 tempest-VolumesGetTest-105560451 None] Lock "cinder-f68c7be6-9a1d-4e15-93d0-ea5bbecf2cfe-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:53:56 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-285d1361-6ee7-404f-ac0d-f9fa545cc31d req-f0f7ceb7-b82e-4141-9edf-922fe59c1f3e tempest-TestInstancesWithCinderVolumes-1294367857 None] Terminate volume connection completed successfully. Jul 06 20:53:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-285d1361-6ee7-404f-ac0d-f9fa545cc31d req-f0f7ceb7-b82e-4141-9edf-922fe59c1f3e tempest-TestInstancesWithCinderVolumes-1294367857 None] Deleting attachment acaa7a0d-279e-401c-ba2c-193d496f7add. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 20:53:56 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.info" returned: 0 in 0.739s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:56 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 20:53:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:56 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.info Jul 06 20:53:56 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:57 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.info" returned: 0 in 0.714s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.512s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Creating offline snapshot d56017af-ea5f-442d-9397-f17c1842596b of volume 1b531682-a907-4f35-910b-05433ea41c1d {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a185434b-7539-46fe-ae8f-000b4c4f4263]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Flow 'volume_create_manager' (fcb57d29-b27b-46fa-9da9-0e46f9402908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22d4e1b-a606-48ac-98be-3cd807854fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22d4e1b-a606-48ac-98be-3cd807854fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1094991989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4fb93eca989e46cf95bdeec8c513e1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:58Z,use_quota=True,user_id='87ddea9560f740819933ddd37c595ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53537e07-8e7c-4f4f-ba59-ba17705e1a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53537e07-8e7c-4f4f-ba59-ba17705e1a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (368330b8-83e3-45c3-a7c3-023bc35fb4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG cinder.image.glance [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Creating Keystone auth plugin from conf {{(pid=87207) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 20:53:57 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d Jul 06 20:53:57 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:53:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:58 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:53:58 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (368330b8-83e3-45c3-a7c3-023bc35fb4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30', 'volume_name': 'volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30', 'volume_size': 1, 'image_id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6600b41119584a67ac9b8504a63b23ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a409ef-776b-4356-b0de-e65e61a60fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a409ef-776b-4356-b0de-e65e61a60fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:53:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54bbe7d-01e1-4268-b95e-4e97c8da572e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:53:58 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Volume e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30', 'volume_size': 1, 'image_id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6600b41119584a67ac9b8504a63b23ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 20:53:58 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Trying to clone e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 from image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d at location (None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}]). {{(pid=87207) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 20:53:58 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d" returned: 0 in 1.070s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:58 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b 1G Jul 06 20:53:58 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Acquiring lock "cinder-7c70980e-3f0c-42cb-abb7-4e0556ac656a-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "cinder-7c70980e-3f0c-42cb-abb7-4e0556ac656a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:58 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_xprgod78devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 20:53:58 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Image download 20.69 MB at 20.69 MB/s Jul 06 20:53:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Acquiring lock "cinder-quobyte-7c70980e-3f0c-42cb-abb7-4e0556ac656a" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:53:58 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8791459d-6e6b-4d23-8325-7132f746c065]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_xprgod78devstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "cinder-quobyte-7c70980e-3f0c-42cb-abb7-4e0556ac656a" acquired by "delete_volume" :: waited 0.039s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:53:58 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e0c9dd-c516-4ea5-9890-6c29c8489756]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:53:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:53:59 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_xprgod78devstack@QuobyteHD Jul 06 20:53:59 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:59 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.073s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:59 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:53:59 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:53:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:53:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:53:59 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a Jul 06 20:53:59 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:53:59 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_xprgod78devstack@QuobyteHD" returned: 0 in 1.115s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:59 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Temporary image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d is fetched for user 87ddea9560f740819933ddd37c595ece. {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 20:53:59 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Jul 06 20:53:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b 1G" returned: 0 in 1.385s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:53:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b531682-a907-4f35-910b-05433ea41c1d -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:00 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b531682-a907-4f35-910b-05433ea41c1d -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b Jul 06 20:54:00 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:00 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8313c0-ae38-40b2-b270-8cce72aee95d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_xprgod78devstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:00 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a" returned: 0 in 1.198s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:00 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a Jul 06 20:54:00 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:00 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_xprgod78devstack@QuobyteHD Jul 06 20:54:00 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:01 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b531682-a907-4f35-910b-05433ea41c1d -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b" returned: 0 in 1.026s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:01 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b is being set with open permissions: ugo+rw: NotImplementedError Jul 06 20:54:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:01 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_xprgod78devstack@QuobyteHD" returned: 0 in 0.995s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:01 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b Jul 06 20:54:01 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:01 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7c70980e-3f0c-42cb-abb7-4e0556ac656a" returned: 0 in 0.971s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:01 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "cinder-quobyte-7c70980e-3f0c-42cb-abb7-4e0556ac656a" released by "delete_volume" :: held 2.249s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:01 devstack cinder-volume[87207]: WARNING cinder.quota [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-979765815-1242949626 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-979765815-1242949626, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:54:01 devstack cinder-volume[87207]: WARNING cinder.quota [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-979765815-1242949626 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-979765815-1242949626, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:54:01 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Created reservations ['02714f0f-ccb5-42e4-974d-33131803530d', '19799c22-4d4a-4c4f-b806-5c4adea40f40', '54f6bb51-ad27-4126-b3e1-65a8a80f40e5', 'a19d854d-bb44-4cb6-9bd7-516f06789881'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:01 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:54:01 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:01 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b" returned: 0 in 0.884s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:01 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.info Jul 06 20:54:01 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:02 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.794s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:02 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:54:02 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Deleted volume successfully. Jul 06 20:54:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-569a5868-052f-4e10-8346-842befba0f43 tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "cinder-7c70980e-3f0c-42cb-abb7-4e0556ac656a-delete_volume" released by "delete_volume" :: held 3.388s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:02 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.info" returned: 0 in 0.749s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:02 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 20:54:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:02 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.info Jul 06 20:54:02 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:02 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-50a4cdcb-32fe-4070-9d66-fe837ddbba6b tempest-GroupsTest-1058193804 None] Group tempest-Group1-2134816816: creating Jul 06 20:54:02 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-50a4cdcb-32fe-4070-9d66-fe837ddbba6b tempest-GroupsTest-1058193804 None] Group tempest-Group1-2134816816: created successfully Jul 06 20:54:02 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-50a4cdcb-32fe-4070-9d66-fe837ddbba6b tempest-GroupsTest-1058193804 None] Create group completed successfully. Jul 06 20:54:03 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.info" returned: 0 in 0.689s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.916s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.322s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1094991989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4fb93eca989e46cf95bdeec8c513e1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:58Z,use_quota=True,user_id='87ddea9560f740819933ddd37c595ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Creating volume e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:54:03 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:03 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 1073741824 Jul 06 20:54:03 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:03 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-6fc62e61-7138-4c6d-aeeb-3811c7f22c18 tempest-GroupSnapshotsTest-1634452977 None] group_snapshot f948ebba-c506-4568-a057-6be96df4e2c4: created successfully Jul 06 20:54:03 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] group_snapshot f948ebba-c506-4568-a057-6be96df4e2c4: deleting Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] group_snapshot f948ebba-c506-4568-a057-6be96df4e2c4: deleting {{(pid=87207) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "cinder-quobyte-bb0000fa-132a-4bce-aa40-656fcbbb3f2e" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-bb0000fa-132a-4bce-aa40-656fcbbb3f2e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "cinder-quobyte-5a159654-9475-4d7c-9170-f9a2c06c879a" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-5a159654-9475-4d7c-9170-f9a2c06c879a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Deleting offline snapshot 5a159654-9475-4d7c-9170-f9a2c06c879a of volume bb0000fa-132a-4bce-aa40-656fcbbb3f2e {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] snapshot_file for this snap is: volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dabf18-410e-4178-baa7-5536a4ce6a2b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:04 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a Jul 06 20:54:04 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:04 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-4516f5bd-3593-44f5-a282-d5041b93d220 tempest-GroupsTest-1058193804 None] Group tempest-Group2-1810224189: creating Jul 06 20:54:04 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-1edd17a8-c656-44d6-a82e-a77cdbd7c780 req-3a012f2f-48ab-44ae-93b2-a50b9b3bb97b tempest-TestInstancesWithCinderVolumes-1294367857 None] Terminate volume connection completed successfully. Jul 06 20:54:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-1edd17a8-c656-44d6-a82e-a77cdbd7c780 req-3a012f2f-48ab-44ae-93b2-a50b9b3bb97b tempest-TestInstancesWithCinderVolumes-1294367857 None] Deleting attachment 0331c607-9f39-4c2a-8f16-b73e5dfe1a27. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 20:54:04 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-4516f5bd-3593-44f5-a282-d5041b93d220 tempest-GroupsTest-1058193804 None] Group tempest-Group2-1810224189: created successfully Jul 06 20:54:04 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-4516f5bd-3593-44f5-a282-d5041b93d220 tempest-GroupsTest-1058193804 None] Create group completed successfully. Jul 06 20:54:04 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 1073741824" returned: 0 in 1.056s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:04 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 Jul 06 20:54:04 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:04 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a" returned: 0 in 0.864s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:54:04 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef271d23-1533-43cf-a1c6-4bcf259ac63d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:04 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e Jul 06 20:54:04 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:05 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30" returned: 0 in 0.662s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:54:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:05 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Attempting download of 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d ((None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}])) to volume e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30. {{(pid=87207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 20:54:05 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd2f22e-8705-408b-a4a2-dde62f7201f9]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d__t_sj4pe {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:05 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d__t_sj4pe Jul 06 20:54:05 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:05 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e" returned: 0 in 0.851s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:05 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a Jul 06 20:54:05 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:05 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Flow 'volume_create_manager' (7bb52ec2-de17-44a2-8c10-4770e51d5160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339db9f5-80e5-4020-86bd-4f9d14cff41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339db9f5-80e5-4020-86bd-4f9d14cff41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-42865883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ea119da-929b-4825-929f-59ebc8847073,host='devstack@QuobyteHD#QuobyteHD',id=fe6c3c2c-a50b-462c-878d-d43b10a617b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a610839dd74f2489ebe6501cdf9367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:06Z,use_quota=True,user_id='621efe6a3b74403cb35917fd1742a820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2396738a-d8ae-4c5a-8581-55d868766fea),volume_type_id=2396738a-d8ae-4c5a-8581-55d868766fea)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f967a2e0-6253-4c8e-8da9-239649801b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f967a2e0-6253-4c8e-8da9-239649801b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c396403-0c47-42ff-ac2e-1d89bffdb815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c396403-0c47-42ff-ac2e-1d89bffdb815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe6c3c2c-a50b-462c-878d-d43b10a617b1', 'volume_name': 'volume-fe6c3c2c-a50b-462c-878d-d43b10a617b1', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217e714b-2cc1-496d-875c-67f54becf79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217e714b-2cc1-496d-875c-67f54becf79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47c806e-d0d8-482e-bdd1-4c1571eae702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:06 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Volume fe6c3c2c-a50b-462c-878d-d43b10a617b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe6c3c2c-a50b-462c-878d-d43b10a617b1', 'volume_size': 1} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1ea119da-929b-4825-929f-59ebc8847073,created_at=2026-07-06T18:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-42865883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ea119da-929b-4825-929f-59ebc8847073,host='devstack@QuobyteHD#QuobyteHD',id=fe6c3c2c-a50b-462c-878d-d43b10a617b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a610839dd74f2489ebe6501cdf9367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:06Z,use_quota=True,user_id='621efe6a3b74403cb35917fd1742a820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2396738a-d8ae-4c5a-8581-55d868766fea),volume_type_id=2396738a-d8ae-4c5a-8581-55d868766fea)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Creating volume fe6c3c2c-a50b-462c-878d-d43b10a617b1 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:54:06 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fe6c3c2c-a50b-462c-878d-d43b10a617b1 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Acquiring lock "cinder-ff8b33e5-9b52-4193-a09a-aa0c75b03d68-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:06 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fe6c3c2c-a50b-462c-878d-d43b10a617b1 1073741824 Jul 06 20:54:06 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "cinder-ff8b33e5-9b52-4193-a09a-aa0c75b03d68-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:06 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d__t_sj4pe" returned: 0 in 0.921s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d__t_sj4pe {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Acquiring lock "cinder-quobyte-ff8b33e5-9b52-4193-a09a-aa0c75b03d68" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "cinder-quobyte-ff8b33e5-9b52-4193-a09a-aa0c75b03d68" acquired by "delete_volume" :: waited 0.032s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[32026001-d76e-4b4e-aa42-25f7497f1121]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:06 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d__t_sj4pe Jul 06 20:54:06 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:06 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68 Jul 06 20:54:06 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:06 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a" returned: 0 in 1.132s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:06 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a Jul 06 20:54:06 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:07 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d__t_sj4pe" returned: 1 in 0.925s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d__t_sj4pe' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:54:07 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d1eeb0-7bce-4b10-b63d-352a65c3e6a1]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_xprgod78devstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:07 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_xprgod78devstack@QuobyteHD Jul 06 20:54:07 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:07 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68" returned: 0 in 1.097s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:07 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fe6c3c2c-a50b-462c-878d-d43b10a617b1 1073741824" returned: 0 in 1.384s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:07 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68 Jul 06 20:54:07 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fe6c3c2c-a50b-462c-878d-d43b10a617b1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:07 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fe6c3c2c-a50b-462c-878d-d43b10a617b1 Jul 06 20:54:07 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:07 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e.5a159654-9475-4d7c-9170-f9a2c06c879a" returned: 0 in 1.113s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-5a159654-9475-4d7c-9170-f9a2c06c879a" released by "_delete_snapshot" :: held 4.124s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-bb0000fa-132a-4bce-aa40-656fcbbb3f2e" released by "delete_snapshot" :: held 4.161s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "cinder-quobyte-1b531682-a907-4f35-910b-05433ea41c1d" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-1b531682-a907-4f35-910b-05433ea41c1d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "cinder-quobyte-d56017af-ea5f-442d-9397-f17c1842596b" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-d56017af-ea5f-442d-9397-f17c1842596b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Deleting offline snapshot d56017af-ea5f-442d-9397-f17c1842596b of volume 1b531682-a907-4f35-910b-05433ea41c1d {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] snapshot_file for this snap is: volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1a17ee-72b6-40ac-8d57-82b8569df1ca]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:08 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b Jul 06 20:54:08 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:08 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_xprgod78devstack@QuobyteHD" returned: 0 in 1.204s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d was qcow2, converting to raw {{(pid=87207) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_xprgod78devstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:08 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_xprgod78devstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 Jul 06 20:54:08 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:08 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fe6c3c2c-a50b-462c-878d-d43b10a617b1" returned: 0 in 1.245s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] <== create_volume: return (2693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.696s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:08 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff8b33e5-9b52-4193-a09a-aa0c75b03d68" returned: 0 in 1.372s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "cinder-quobyte-ff8b33e5-9b52-4193-a09a-aa0c75b03d68" released by "delete_volume" :: held 2.557s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47c806e-d0d8-482e-bdd1-4c1571eae702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe6c3c2c-a50b-462c-878d-d43b10a617b1', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a2fe15-7b25-4ddf-baf5-399f1ab8a1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:08 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Volume volume-fe6c3c2c-a50b-462c-878d-d43b10a617b1 (fe6c3c2c-a50b-462c-878d-d43b10a617b1): created successfully Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a2fe15-7b25-4ddf-baf5-399f1ab8a1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Flow 'volume_create_manager' (7bb52ec2-de17-44a2-8c10-4770e51d5160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:54:08 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-5b774415-9f16-4b93-a822-6c801ea0787f tempest-GroupsTest-1058193804 None] Created volume successfully. Jul 06 20:54:08 devstack cinder-volume[87207]: WARNING cinder.quota [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2006515038-1309925640 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2006515038-1309925640, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:54:08 devstack cinder-volume[87207]: WARNING cinder.quota [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2006515038-1309925640 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2006515038-1309925640, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:54:09 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Created reservations ['c1b62527-8187-4100-a11e-66065582d3c1', 'cc9287d2-3f5f-41bb-adb5-063be4cf92d9', 'b19c7dff-faaf-4058-b6e1-716500172c32', 'fdbe9866-83cf-4c76-b323-9793d429d7da'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:09 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:54:09 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:09 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b" returned: 0 in 1.232s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b531682-a907-4f35-910b-05433ea41c1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:54:09 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23e54d0-ee91-46df-a836-c5cc4804ada6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:09 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d Jul 06 20:54:09 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:10 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.027s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:10 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:54:10 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Deleted volume successfully. Jul 06 20:54:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-04b8719b-3565-48cb-ae11-38e784e1b3a9 tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "cinder-ff8b33e5-9b52-4193-a09a-aa0c75b03d68-delete_volume" released by "delete_volume" :: held 4.014s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:10 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d" returned: 0 in 1.314s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:10 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b Jul 06 20:54:10 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] Acquiring lock "cinder-quobyte-fe6c3c2c-a50b-462c-878d-d43b10a617b1" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] Lock "cinder-quobyte-fe6c3c2c-a50b-462c-878d-d43b10a617b1" acquired by "delete_volume" :: waited 0.038s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:10 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28be87d-ecc2-4240-ba87-1d44f39651dc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fe6c3c2c-a50b-462c-878d-d43b10a617b1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:11 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fe6c3c2c-a50b-462c-878d-d43b10a617b1 Jul 06 20:54:11 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:11 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_xprgod78devstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30" returned: 0 in 2.851s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:11 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_xprgod78devstack@QuobyteHD, size 112.00 MB, duration 2.85 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 20:54:11 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Converted 112.00 MB image at 39.27 MB/s Jul 06 20:54:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:11 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 1G Jul 06 20:54:11 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:11 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b" returned: 0 in 1.007s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:11 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b Jul 06 20:54:11 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:11 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fe6c3c2c-a50b-462c-878d-d43b10a617b1" returned: 0 in 1.105s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fe6c3c2c-a50b-462c-878d-d43b10a617b1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:12 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fe6c3c2c-a50b-462c-878d-d43b10a617b1 Jul 06 20:54:12 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:12 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 1G" returned: 0 in 1.182s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:12 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef4378d-56c4-4fc3-8a9c-f59d8886414b]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:12 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 Jul 06 20:54:12 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:12 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d.d56017af-ea5f-442d-9397-f17c1842596b" returned: 0 in 1.050s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:12 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-d56017af-ea5f-442d-9397-f17c1842596b" released by "_delete_snapshot" :: held 4.745s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:12 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-1b531682-a907-4f35-910b-05433ea41c1d" released by "delete_snapshot" :: held 4.780s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:12 devstack cinder-volume[87207]: WARNING cinder.quota [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-71397188 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-71397188, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:54:12 devstack cinder-volume[87207]: WARNING cinder.quota [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-71397188 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-71397188, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:54:12 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fe6c3c2c-a50b-462c-878d-d43b10a617b1" returned: 0 in 1.026s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:13 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Created reservations ['c8221388-948f-4f72-9fe3-9ee5400cc1bc', '8206c2ae-dfc7-4c78-9b8b-fde9f2c534a5', '03533663-04a9-415d-9b4a-19f912971fbf', '6b24625f-d294-4c9f-a67b-4cba73932e2c'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:13 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] Lock "cinder-quobyte-fe6c3c2c-a50b-462c-878d-d43b10a617b1" released by "delete_volume" :: held 2.206s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:13 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] Created reservations ['0021d14e-f27b-4f97-b08f-85c15a8419af'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:13 devstack cinder-volume[87207]: WARNING cinder.quota [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-673660104 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-673660104, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:54:13 devstack cinder-volume[87207]: WARNING cinder.quota [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-673660104 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-673660104, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:54:13 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] Created reservations ['794c711a-5337-45b9-8c01-bef3f500959e', 'ad29c51a-333f-4f03-b9fb-eb2334c8cbac', 'c3e3e9ff-0643-4510-b842-258e624724a6', 'bebb9f97-1ab2-4d42-95a0-21fb441d093c'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:13 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] Created reservations ['c6abc903-67cb-4bdb-8b9a-e45b43709d48', 'ddf85fb0-d00f-43c5-91b8-fc5ac68435f8', '0b5cdbda-9bf9-49cc-92ca-9e2fac097ef5', 'f439dead-5329-41d8-94a5-75bc65058a0d'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:13 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-a31eb325-87f1-4816-9c07-fe6a46415e91 tempest-GroupSnapshotsTest-1634452977 None] group_snapshot f948ebba-c506-4568-a057-6be96df4e2c4: deleted successfully Jul 06 20:54:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:13 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30" returned: 0 in 1.078s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:13 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:54:13 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:13 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 Jul 06 20:54:13 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "cinder-quobyte-1b531682-a907-4f35-910b-05433ea41c1d" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-1b531682-a907-4f35-910b-05433ea41c1d" acquired by "delete_volume" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:14 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.809s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:54:14 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-c6d3d1a5-09dc-45b8-b4d4-3674918b62fc tempest-GroupsTest-1058193804 None] Delete group completed successfully. Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7b718d-3a3d-41fc-b08f-3c1ac734ac27]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:14 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30" returned: 1 in 0.887s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Downloaded image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d ((None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}])) to volume e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 successfully. {{(pid=87207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Temporary image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d for user 87ddea9560f740819933ddd37c595ece is deleted. {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Marking volume e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 as bootable. {{(pid=87207) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 20:54:14 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d Jul 06 20:54:14 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Copying metadata from image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d to e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30. {{(pid=87207) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Creating volume glance metadata for volume e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 backed by image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87207) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54bbe7d-01e1-4268-b95e-4e97c8da572e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30', 'volume_size': 1, 'image_id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6600b41119584a67ac9b8504a63b23ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48bc03ea-71d7-42cd-a29c-cddcab780a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:14 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Volume volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 (e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30): created successfully Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48bc03ea-71d7-42cd-a29c-cddcab780a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Flow 'volume_create_manager' (fcb57d29-b27b-46fa-9da9-0e46f9402908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:54:14 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-977027c9-91dc-4e47-841c-c60db420f3c1 tempest-VolumesGetTest-105560451 None] Created volume successfully. Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-56c38ea8-a9bc-419c-b608-5d9120fba705 tempest-GroupsTest-1058193804 None] Created reservations ['24592c0e-ecb3-43b1-a5f0-0388e29c8fb0'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-56c38ea8-a9bc-419c-b608-5d9120fba705 tempest-GroupsTest-1058193804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-56c38ea8-a9bc-419c-b608-5d9120fba705 tempest-GroupsTest-1058193804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-56c38ea8-a9bc-419c-b608-5d9120fba705 tempest-GroupsTest-1058193804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-56c38ea8-a9bc-419c-b608-5d9120fba705 tempest-GroupsTest-1058193804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-56c38ea8-a9bc-419c-b608-5d9120fba705 tempest-GroupsTest-1058193804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-56c38ea8-a9bc-419c-b608-5d9120fba705 tempest-GroupsTest-1058193804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:14 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:54:14 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:14 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-74cabe94-2977-49c2-a20c-437b475ebdcf req-c7d0ad35-1496-4cac-9509-e31b93db3b09 tempest-TestInstancesWithCinderVolumes-1294367857 None] Terminate volume connection completed successfully. Jul 06 20:54:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-74cabe94-2977-49c2-a20c-437b475ebdcf req-c7d0ad35-1496-4cac-9509-e31b93db3b09 tempest-TestInstancesWithCinderVolumes-1294367857 None] Deleting attachment 6363ffed-edaf-4f3b-8cc6-195fbb211a4e. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 20:54:15 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d" returned: 0 in 0.797s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:15 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d Jul 06 20:54:15 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:15 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-56c38ea8-a9bc-419c-b608-5d9120fba705 tempest-GroupsTest-1058193804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.692s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:15 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-56c38ea8-a9bc-419c-b608-5d9120fba705 tempest-GroupsTest-1058193804 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:54:15 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-56c38ea8-a9bc-419c-b608-5d9120fba705 tempest-GroupsTest-1058193804 None] Delete group completed successfully. Jul 06 20:54:15 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1b531682-a907-4f35-910b-05433ea41c1d" returned: 0 in 0.726s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-1b531682-a907-4f35-910b-05433ea41c1d" released by "delete_volume" :: held 1.636s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "cinder-quobyte-bb0000fa-132a-4bce-aa40-656fcbbb3f2e" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-bb0000fa-132a-4bce-aa40-656fcbbb3f2e" acquired by "delete_volume" :: waited 0.026s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd01f28-527d-4d1f-a85c-71d2d38e9934]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:16 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e Jul 06 20:54:16 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Flow 'volume_create_manager' (5bf81f51-915e-4623-921b-b2f51200e2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682f011e-9c4a-4174-8e31-280239ac74a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682f011e-9c4a-4174-8e31-280239ac74a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:54:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1634269221',display_name='tempest-VolumesGetTest-Volume-1317823728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c546c11b-a933-4e93-80df-a7680f1d8276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb93eca989e46cf95bdeec8c513e1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:16Z,use_quota=True,user_id='87ddea9560f740819933ddd37c595ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0fe421d-22db-49ab-9360-c920e829cdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0fe421d-22db-49ab-9360-c920e829cdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef51811-fb81-454e-a03f-8665b5f4b019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef51811-fb81-454e-a03f-8665b5f4b019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c546c11b-a933-4e93-80df-a7680f1d8276', 'volume_name': 'volume-c546c11b-a933-4e93-80df-a7680f1d8276', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085b92b8-7b09-469a-b328-30cdbb24461d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085b92b8-7b09-469a-b328-30cdbb24461d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40025d6d-fac5-4031-8d8e-27428097b1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:16 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Volume c546c11b-a933-4e93-80df-a7680f1d8276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c546c11b-a933-4e93-80df-a7680f1d8276', 'volume_size': 1} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:54:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1634269221',display_name='tempest-VolumesGetTest-Volume-1317823728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c546c11b-a933-4e93-80df-a7680f1d8276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb93eca989e46cf95bdeec8c513e1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:16Z,use_quota=True,user_id='87ddea9560f740819933ddd37c595ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Creating volume c546c11b-a933-4e93-80df-a7680f1d8276 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:54:16 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c546c11b-a933-4e93-80df-a7680f1d8276 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:16 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c546c11b-a933-4e93-80df-a7680f1d8276 1073741824 Jul 06 20:54:16 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:16 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9df0bcdb-5d54-4de9-87ae-dc044b2c0286 tempest-GroupsTest-1058193804 None] Group tempest-GroupsTest-Group-124398745: creating Jul 06 20:54:16 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9df0bcdb-5d54-4de9-87ae-dc044b2c0286 tempest-GroupsTest-1058193804 None] Group tempest-GroupsTest-Group-124398745: created successfully Jul 06 20:54:16 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9df0bcdb-5d54-4de9-87ae-dc044b2c0286 tempest-GroupsTest-1058193804 None] Create group completed successfully. Jul 06 20:54:16 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e" returned: 0 in 0.844s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:16 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e Jul 06 20:54:16 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:17 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c546c11b-a933-4e93-80df-a7680f1d8276 1073741824" returned: 0 in 0.853s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c546c11b-a933-4e93-80df-a7680f1d8276 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:17 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c546c11b-a933-4e93-80df-a7680f1d8276 Jul 06 20:54:17 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:17 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bb0000fa-132a-4bce-aa40-656fcbbb3f2e" returned: 0 in 0.710s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-bb0000fa-132a-4bce-aa40-656fcbbb3f2e" released by "delete_volume" :: held 1.672s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:17 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Created reservations ['997dd133-69c0-47d1-b285-cb75e68baa85'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:17 devstack cinder-volume[87207]: WARNING cinder.quota [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-71397188 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-71397188, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:54:17 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Created reservations ['c14f1253-e955-4d9d-8095-9f9ecea52929', '9da3650d-a3e3-46ae-b085-a327f797b8b2', '54f17bf0-8f1b-44f3-9af1-dbd9b44fc378', '6bb6369d-75a7-4056-a3e2-28594a9eeec9'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:17 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Created reservations ['1483359c-d50c-4809-801a-09646568ec15', 'f15f1b01-a1ab-497d-9008-d9eb82ea440b', '7a2e3b8f-4e57-48df-9903-ff19f67a029f', 'cd630bc6-8c14-47e2-9301-fbe7d5c14de7'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:54:18 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Flow 'volume_create_manager' (db86e68b-88c6-430e-a84f-1672a9a5a66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9add99-903b-4ad9-b5c8-509e38ad11e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c546c11b-a933-4e93-80df-a7680f1d8276" returned: 0 in 0.892s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9add99-903b-4ad9-b5c8-509e38ad11e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-532435725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1517c40-91bf-41ad-8bfe-49c6548924c0,host='devstack@QuobyteHD#QuobyteHD',id=f6cbe7d4-3038-436b-8727-706c9359b695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a610839dd74f2489ebe6501cdf9367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:18Z,use_quota=True,user_id='621efe6a3b74403cb35917fd1742a820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6247e0e-a98d-4f54-b8c8-5b05cf7a7ca3),volume_type_id=b6247e0e-a98d-4f54-b8c8-5b05cf7a7ca3)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbcb63b-0f39-4f04-b084-6e114387b34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbcb63b-0f39-4f04-b084-6e114387b34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39ae8d4-261f-4445-87b0-2c63aab47f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39ae8d4-261f-4445-87b0-2c63aab47f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6cbe7d4-3038-436b-8727-706c9359b695', 'volume_name': 'volume-f6cbe7d4-3038-436b-8727-706c9359b695', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31277797-c1a7-43b7-bc52-6c806fac2c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31277797-c1a7-43b7-bc52-6c806fac2c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6471831-60d0-4066-a551-2c9c56fa9811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:18 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Volume f6cbe7d4-3038-436b-8727-706c9359b695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6cbe7d4-3038-436b-8727-706c9359b695', 'volume_size': 1} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c1517c40-91bf-41ad-8bfe-49c6548924c0,created_at=2026-07-06T18:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-532435725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1517c40-91bf-41ad-8bfe-49c6548924c0,host='devstack@QuobyteHD#QuobyteHD',id=f6cbe7d4-3038-436b-8727-706c9359b695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a610839dd74f2489ebe6501cdf9367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:18Z,use_quota=True,user_id='621efe6a3b74403cb35917fd1742a820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6247e0e-a98d-4f54-b8c8-5b05cf7a7ca3),volume_type_id=b6247e0e-a98d-4f54-b8c8-5b05cf7a7ca3)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Creating volume f6cbe7d4-3038-436b-8727-706c9359b695 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:54:18 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6cbe7d4-3038-436b-8727-706c9359b695 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:18 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6cbe7d4-3038-436b-8727-706c9359b695 1073741824 Jul 06 20:54:18 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Acquiring lock "cinder-582a8d51-b032-485f-a198-3cab8f34f57f-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40025d6d-fac5-4031-8d8e-27428097b1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c546c11b-a933-4e93-80df-a7680f1d8276', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:18 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:54:18 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e8107a-7155-4bff-b51b-ecd11855b3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:18 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Volume volume-c546c11b-a933-4e93-80df-a7680f1d8276 (c546c11b-a933-4e93-80df-a7680f1d8276): created successfully Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e8107a-7155-4bff-b51b-ecd11855b3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Flow 'volume_create_manager' (5bf81f51-915e-4623-921b-b2f51200e2e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "cinder-582a8d51-b032-485f-a198-3cab8f34f57f-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:18 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-59f43014-274d-4f0f-a122-7165d864a98f tempest-VolumesGetTest-105560451 None] Created volume successfully. Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Acquiring lock "cinder-quobyte-582a8d51-b032-485f-a198-3cab8f34f57f" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "cinder-quobyte-582a8d51-b032-485f-a198-3cab8f34f57f" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[77567edd-d358-4a27-9e84-b4f3441fb015]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:18 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f Jul 06 20:54:18 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:18 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.692s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:18 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:54:18 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-c08f6379-2fe9-4d65-9d78-ba56a2150d84 tempest-GroupSnapshotsTest-1634452977 None] Delete group completed successfully. Jul 06 20:54:19 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6cbe7d4-3038-436b-8727-706c9359b695 1073741824" returned: 0 in 0.998s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6cbe7d4-3038-436b-8727-706c9359b695 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:19 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6cbe7d4-3038-436b-8727-706c9359b695 Jul 06 20:54:19 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:19 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f" returned: 0 in 0.869s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] Acquiring lock "cinder-c546c11b-a933-4e93-80df-a7680f1d8276-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] Lock "cinder-c546c11b-a933-4e93-80df-a7680f1d8276-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] Acquiring lock "cinder-quobyte-c546c11b-a933-4e93-80df-a7680f1d8276" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:19 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f Jul 06 20:54:19 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] Lock "cinder-quobyte-c546c11b-a933-4e93-80df-a7680f1d8276" acquired by "delete_volume" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:19 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[70552d21-55bb-4db9-b352-c84b5e209e3b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c546c11b-a933-4e93-80df-a7680f1d8276 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:19 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c546c11b-a933-4e93-80df-a7680f1d8276 Jul 06 20:54:19 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:19 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-692f430b-0e0f-4863-b63c-e49df39ea264 tempest-GroupSnapshotsTest-1634452977 None] Group tempest-GroupSnapshotsTest-Group-886000277: creating Jul 06 20:54:19 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-692f430b-0e0f-4863-b63c-e49df39ea264 tempest-GroupSnapshotsTest-1634452977 None] Group tempest-GroupSnapshotsTest-Group-886000277: created successfully Jul 06 20:54:19 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-692f430b-0e0f-4863-b63c-e49df39ea264 tempest-GroupSnapshotsTest-1634452977 None] Create group completed successfully. Jul 06 20:54:20 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6cbe7d4-3038-436b-8727-706c9359b695" returned: 0 in 0.849s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:20 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:54:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6471831-60d0-4066-a551-2c9c56fa9811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6cbe7d4-3038-436b-8727-706c9359b695', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2242b07-6c2b-4a2d-9396-a7b98ba1d6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:20 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Volume volume-f6cbe7d4-3038-436b-8727-706c9359b695 (f6cbe7d4-3038-436b-8727-706c9359b695): created successfully Jul 06 20:54:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2242b07-6c2b-4a2d-9396-a7b98ba1d6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Flow 'volume_create_manager' (db86e68b-88c6-430e-a84f-1672a9a5a66e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:54:20 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-949b0b52-a761-49b6-bd77-ede8211d553b tempest-GroupsTest-1058193804 None] Created volume successfully. Jul 06 20:54:20 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f" returned: 1 in 0.897s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:54:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:20 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f Jul 06 20:54:20 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:20 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c546c11b-a933-4e93-80df-a7680f1d8276" returned: 0 in 0.871s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c546c11b-a933-4e93-80df-a7680f1d8276 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:20 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c546c11b-a933-4e93-80df-a7680f1d8276 Jul 06 20:54:20 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:20 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-582a8d51-b032-485f-a198-3cab8f34f57f" returned: 0 in 0.694s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "cinder-quobyte-582a8d51-b032-485f-a198-3cab8f34f57f" released by "delete_volume" :: held 2.539s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:21 devstack cinder-volume[87207]: WARNING cinder.quota [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2089599491-508580114 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2089599491-508580114, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:54:21 devstack cinder-volume[87207]: WARNING cinder.quota [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2089599491-508580114 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2089599491-508580114, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Flow 'volume_create_manager' (8daaffcc-4b5b-4942-bf91-c4eb9f888c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a044a03e-2fb1-4d64-940b-da7f7bd91d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Created reservations ['12de859c-0ded-4d8c-bb71-f1cb05f34aa6', '55b09de6-923b-4a50-9d23-997130425e46', '6569f0b5-2044-4f00-8c4a-35e501e03586', '128976b2-a80f-45cd-b36f-bc93d2753e25'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a044a03e-2fb1-4d64-940b-da7f7bd91d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-485255281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1517c40-91bf-41ad-8bfe-49c6548924c0,host='devstack@QuobyteHD#QuobyteHD',id=4f311df6-05da-4966-878a-e4f8e3389b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a610839dd74f2489ebe6501cdf9367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:21Z,use_quota=True,user_id='621efe6a3b74403cb35917fd1742a820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6247e0e-a98d-4f54-b8c8-5b05cf7a7ca3),volume_type_id=b6247e0e-a98d-4f54-b8c8-5b05cf7a7ca3)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b310dd1e-b909-4c74-a8f6-35bf3b7ba35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b310dd1e-b909-4c74-a8f6-35bf3b7ba35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd70fed-d090-4f31-a8ca-0e5e09abf43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd70fed-d090-4f31-a8ca-0e5e09abf43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f311df6-05da-4966-878a-e4f8e3389b6c', 'volume_name': 'volume-4f311df6-05da-4966-878a-e4f8e3389b6c', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f3c4d7-eec7-4d97-9b06-a30c15193444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f3c4d7-eec7-4d97-9b06-a30c15193444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a912d0e-f350-4035-9f00-c1ab606e3507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:21 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Volume 4f311df6-05da-4966-878a-e4f8e3389b6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f311df6-05da-4966-878a-e4f8e3389b6c', 'volume_size': 1} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c1517c40-91bf-41ad-8bfe-49c6548924c0,created_at=2026-07-06T18:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-485255281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1517c40-91bf-41ad-8bfe-49c6548924c0,host='devstack@QuobyteHD#QuobyteHD',id=4f311df6-05da-4966-878a-e4f8e3389b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a610839dd74f2489ebe6501cdf9367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:21Z,use_quota=True,user_id='621efe6a3b74403cb35917fd1742a820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6247e0e-a98d-4f54-b8c8-5b05cf7a7ca3),volume_type_id=b6247e0e-a98d-4f54-b8c8-5b05cf7a7ca3)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Creating volume 4f311df6-05da-4966-878a-e4f8e3389b6c {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:54:21 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4f311df6-05da-4966-878a-e4f8e3389b6c 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:21 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:21 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4f311df6-05da-4966-878a-e4f8e3389b6c 1073741824 Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c546c11b-a933-4e93-80df-a7680f1d8276" returned: 0 in 0.778s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:21 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] Lock "cinder-quobyte-c546c11b-a933-4e93-80df-a7680f1d8276" released by "delete_volume" :: held 1.705s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:21 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] Created reservations ['77eaef2a-acd7-414c-8a67-1ed2cbe5beec', '608b9b39-13e1-40b6-997d-582f46ca60b6', 'ab6b2a43-73a8-4929-91d4-896ddc3998a3', 'c1ab1f16-03d6-4371-aa34-d603d1a95d70'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:21 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:21 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:54:21 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Flow 'volume_create_manager' (bfdfe9cf-b691-4920-8979-77477b9c905f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95055754-fa9f-445e-a7a5-b888b9e27b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95055754-fa9f-445e-a7a5-b888b9e27b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2044518395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e7022af-26b8-4f2f-bd8a-9c538fa508b2,host='devstack@QuobyteHD#QuobyteHD',id=d6f256c4-1220-4701-872b-2e5f7a0dc942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85478e6cf691404d8f4e6b3c9736a9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:22Z,use_quota=True,user_id='dbe258cbe9a24a428f1db480ccd86c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60aa18dc-7f9a-47d8-96a9-14dac535eec3),volume_type_id=60aa18dc-7f9a-47d8-96a9-14dac535eec3)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3d7cdf-9983-44a8-8c2c-e71ad1675311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3d7cdf-9983-44a8-8c2c-e71ad1675311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd96834-9cc0-47af-b936-58f2719e6dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd96834-9cc0-47af-b936-58f2719e6dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6f256c4-1220-4701-872b-2e5f7a0dc942', 'volume_name': 'volume-d6f256c4-1220-4701-872b-2e5f7a0dc942', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4eff5e-2cdd-4dcf-bb2d-b76f02de2908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4eff5e-2cdd-4dcf-bb2d-b76f02de2908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f472bdc-1c10-4090-93b7-74fc56c0b2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:21 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Volume d6f256c4-1220-4701-872b-2e5f7a0dc942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6f256c4-1220-4701-872b-2e5f7a0dc942', 'volume_size': 1} Jul 06 20:54:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] Acquiring lock "cinder-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] Lock "cinder-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] Acquiring lock "cinder-quobyte-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] Lock "cinder-quobyte-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30" acquired by "delete_volume" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:22 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdf8790-8391-4f97-a3ed-2105d0b817a0]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:22 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:22 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 Jul 06 20:54:22 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.007s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:22 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:54:22 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Deleted volume successfully. Jul 06 20:54:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-21f19974-a300-42fa-a629-fec8c8d89eaf tempest-TestInstancesWithCinderVolumes-1294367857 None] Lock "cinder-582a8d51-b032-485f-a198-3cab8f34f57f-delete_volume" released by "delete_volume" :: held 4.012s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:22 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4f311df6-05da-4966-878a-e4f8e3389b6c 1073741824" returned: 0 in 1.315s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4f311df6-05da-4966-878a-e4f8e3389b6c {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:22 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.135s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:22 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:54:22 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] Deleted volume successfully. Jul 06 20:54:22 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4f311df6-05da-4966-878a-e4f8e3389b6c Jul 06 20:54:22 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e82270f0-2fd3-41f6-85df-72fe959a9b2a tempest-VolumesGetTest-105560451 None] Lock "cinder-c546c11b-a933-4e93-80df-a7680f1d8276-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:23 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30" returned: 0 in 0.914s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:23 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4f311df6-05da-4966-878a-e4f8e3389b6c" returned: 0 in 0.710s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:23 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.449s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:23 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8e7022af-26b8-4f2f-bd8a-9c538fa508b2,created_at=2026-07-06T18:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2044518395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e7022af-26b8-4f2f-bd8a-9c538fa508b2,host='devstack@QuobyteHD#QuobyteHD',id=d6f256c4-1220-4701-872b-2e5f7a0dc942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85478e6cf691404d8f4e6b3c9736a9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:22Z,use_quota=True,user_id='dbe258cbe9a24a428f1db480ccd86c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60aa18dc-7f9a-47d8-96a9-14dac535eec3),volume_type_id=60aa18dc-7f9a-47d8-96a9-14dac535eec3)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Creating volume d6f256c4-1220-4701-872b-2e5f7a0dc942 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:54:23 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a912d0e-f350-4035-9f00-c1ab606e3507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f311df6-05da-4966-878a-e4f8e3389b6c', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:23 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942 1073741824 Jul 06 20:54:23 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed77410-ffa2-4dbc-8aa0-09028f322763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:23 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Volume volume-4f311df6-05da-4966-878a-e4f8e3389b6c (4f311df6-05da-4966-878a-e4f8e3389b6c): created successfully Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed77410-ffa2-4dbc-8aa0-09028f322763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Flow 'volume_create_manager' (8daaffcc-4b5b-4942-bf91-c4eb9f888c42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:54:23 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-8df84593-a8c6-4d8a-ab11-7ce8a8ccc5b4 tempest-GroupsTest-1058193804 None] Created volume successfully. Jul 06 20:54:23 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-458a589a-928c-4cda-81f1-62af6f3ed4c9 tempest-GroupsTest-1058193804 None] Update group completed successfully. Jul 06 20:54:24 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30" returned: 1 in 1.075s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:54:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:24 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30 Jul 06 20:54:24 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:24 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942 1073741824" returned: 0 in 0.999s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:24 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942 Jul 06 20:54:24 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:24 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30" returned: 0 in 0.699s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] Lock "cinder-quobyte-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30" released by "delete_volume" :: held 2.761s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:24 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] Created reservations ['5c7bf5c2-4a9a-4019-bcac-bebb106dd53c', '6eec0f32-ed28-4bb3-85b1-7856d063a7d3', 'f90a03c3-46f4-4c70-9cad-3420d4bfe57d', '9c02a4c5-03d2-4107-a93e-4be4620084a1'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:25 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:54:25 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:25 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942" returned: 0 in 0.767s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:54:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f472bdc-1c10-4090-93b7-74fc56c0b2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6f256c4-1220-4701-872b-2e5f7a0dc942', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3caed275-700c-4a28-91d3-e10d4ccb6484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:25 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Volume volume-d6f256c4-1220-4701-872b-2e5f7a0dc942 (d6f256c4-1220-4701-872b-2e5f7a0dc942): created successfully Jul 06 20:54:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3caed275-700c-4a28-91d3-e10d4ccb6484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Flow 'volume_create_manager' (bfdfe9cf-b691-4920-8979-77477b9c905f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:54:25 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-1cce2524-3195-41ed-85b7-3ecc7d16e867 tempest-GroupSnapshotsTest-1634452977 None] Created volume successfully. Jul 06 20:54:25 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f5a3950a-22f1-4cff-ba4b-c7871c2a8fb7 tempest-GroupsTest-1058193804 None] Update group completed successfully. Jul 06 20:54:25 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.842s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:25 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:54:25 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] Deleted volume successfully. Jul 06 20:54:25 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-17073b9d-e8e5-4533-8357-315d69cc1266 tempest-VolumesGetTest-105560451 None] Lock "cinder-e1604d75-f3c1-4ce7-b66d-2a5b2eac3e30-delete_volume" released by "delete_volume" :: held 3.857s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:26 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] GroupSnapshot 6f8d2f6a-2cc3-4ca8-895c-8ba54c3a51ab: creating. Jul 06 20:54:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] Group snapshot 6f8d2f6a-2cc3-4ca8-895c-8ba54c3a51ab: creating. {{(pid=87207) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 20:54:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] Creating offline snapshot 178cb32d-791f-4a0f-8ba7-088f3f9bebd2 of volume d6f256c4-1220-4701-872b-2e5f7a0dc942 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:54:26 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a032dcb-44f1-4f5c-82c3-e7bbbfca9412]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Acquiring lock "cinder-quobyte-4f311df6-05da-4966-878a-e4f8e3389b6c" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Lock "cinder-quobyte-4f311df6-05da-4966-878a-e4f8e3389b6c" acquired by "delete_volume" :: waited 0.069s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:27 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942 Jul 06 20:54:27 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:27 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ffb16f-a66e-4bd2-8316-559d35cc04b6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4f311df6-05da-4966-878a-e4f8e3389b6c {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:27 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4f311df6-05da-4966-878a-e4f8e3389b6c Jul 06 20:54:27 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:28 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942" returned: 0 in 1.118s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:28 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2 1G Jul 06 20:54:28 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:28 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4f311df6-05da-4966-878a-e4f8e3389b6c" returned: 0 in 1.040s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4f311df6-05da-4966-878a-e4f8e3389b6c {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:28 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4f311df6-05da-4966-878a-e4f8e3389b6c Jul 06 20:54:28 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:29 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4f311df6-05da-4966-878a-e4f8e3389b6c" returned: 0 in 0.856s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Lock "cinder-quobyte-4f311df6-05da-4966-878a-e4f8e3389b6c" released by "delete_volume" :: held 2.052s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Acquiring lock "cinder-quobyte-f6cbe7d4-3038-436b-8727-706c9359b695" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Lock "cinder-quobyte-f6cbe7d4-3038-436b-8727-706c9359b695" acquired by "delete_volume" :: waited 0.024s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f97aa94-802b-41bf-bb1e-a3ad60603629]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:29 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6cbe7d4-3038-436b-8727-706c9359b695 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2 1G" returned: 0 in 1.169s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6f256c4-1220-4701-872b-2e5f7a0dc942 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:29 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6f256c4-1220-4701-872b-2e5f7a0dc942 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2 Jul 06 20:54:29 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:29 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6cbe7d4-3038-436b-8727-706c9359b695 Jul 06 20:54:29 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Flow 'volume_create_manager' (ca5da9a8-8edc-4dad-b2ee-f9d42f704893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16612e7-2d98-4816-b075-bfaf2a74d423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16612e7-2d98-4816-b075-bfaf2a74d423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-967462523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3075efc7-9be4-4c7f-a2c9-7348d4b8eb64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716ca8d2966a44e8b4f5ab9139274f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:29Z,use_quota=True,user_id='b9f432c6db694c018ed2e71f4f759189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56da21a7-eb43-4f5f-ad63-adf35f6bfdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56da21a7-eb43-4f5f-ad63-adf35f6bfdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7637d9c8-f8db-4c66-9082-056f75bdf87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7637d9c8-f8db-4c66-9082-056f75bdf87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3075efc7-9be4-4c7f-a2c9-7348d4b8eb64', 'volume_name': 'volume-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f20707-a212-4a32-a09f-5175e5042372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f20707-a212-4a32-a09f-5175e5042372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5dab02c-a418-42ac-8896-7d396a6428d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:29 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Volume 3075efc7-9be4-4c7f-a2c9-7348d4b8eb64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64', 'volume_size': 1} Jul 06 20:54:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:30 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6cbe7d4-3038-436b-8727-706c9359b695" returned: 0 in 0.851s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6cbe7d4-3038-436b-8727-706c9359b695 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:30 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6cbe7d4-3038-436b-8727-706c9359b695 Jul 06 20:54:30 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:30 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6f256c4-1220-4701-872b-2e5f7a0dc942 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2" returned: 0 in 0.921s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:30 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 20:54:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:30 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2 Jul 06 20:54:30 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:30 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6cbe7d4-3038-436b-8727-706c9359b695" returned: 0 in 0.697s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:30 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Lock "cinder-quobyte-f6cbe7d4-3038-436b-8727-706c9359b695" released by "delete_volume" :: held 1.614s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:30 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Created reservations ['1221cc0d-8fb1-454c-a8f3-c5017d3ff7cd'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:30 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2" returned: 0 in 0.727s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:30 devstack cinder-volume[87207]: WARNING cinder.quota [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1077217030 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1077217030, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:54:30 devstack cinder-volume[87207]: WARNING cinder.quota [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1077217030 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1077217030, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:54:30 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.info Jul 06 20:54:30 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:30 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Created reservations ['7c3b6e5d-f086-4225-8568-36c69db94984', 'bbec67f5-b670-4c42-ab65-ef1d617acb03', 'f040a79f-3f70-463b-bcba-1d02d6846fba', '1b01bffa-8fde-4fc6-826a-aa81b4d4bab7'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:31 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Created reservations ['0d5171a7-4b8a-4c5a-89e1-40cc48aec4cd', '26a0ea3b-afef-44c1-a7b0-7c8589d4513c', 'bcc5e30f-7fb7-402c-9dea-1dc2c7729dd9', '65c49f86-f94a-4703-8956-9a67e2831fcf'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:31 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:54:31 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:31 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.info" returned: 0 in 0.794s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:31 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 20:54:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:31 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.info Jul 06 20:54:31 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:32 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.809s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:32 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:54:32 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-7af66b51-c8d8-4c9c-9180-6f7eb1fbbfef tempest-GroupsTest-1058193804 None] Delete group completed successfully. Jul 06 20:54:32 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.info" returned: 0 in 0.778s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.614s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.932s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:32 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-967462523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3075efc7-9be4-4c7f-a2c9-7348d4b8eb64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716ca8d2966a44e8b4f5ab9139274f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:29Z,use_quota=True,user_id='b9f432c6db694c018ed2e71f4f759189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:54:32 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Creating volume 3075efc7-9be4-4c7f-a2c9-7348d4b8eb64 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:54:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:32 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:32 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:32 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:54:32 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:54:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:32 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64 1073741824 Jul 06 20:54:32 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:32 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-63e9357b-a3c3-4d47-bbb1-3c6c30a8c5f9 tempest-GroupSnapshotsTest-1634452977 None] group_snapshot 6f8d2f6a-2cc3-4ca8-895c-8ba54c3a51ab: created successfully Jul 06 20:54:33 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] group_snapshot 6f8d2f6a-2cc3-4ca8-895c-8ba54c3a51ab: deleting Jul 06 20:54:33 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64 1073741824" returned: 0 in 1.029s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] group_snapshot 6f8d2f6a-2cc3-4ca8-895c-8ba54c3a51ab: deleting {{(pid=87207) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 20:54:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "cinder-quobyte-d6f256c4-1220-4701-872b-2e5f7a0dc942" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:33 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64 Jul 06 20:54:33 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-d6f256c4-1220-4701-872b-2e5f7a0dc942" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "cinder-quobyte-178cb32d-791f-4a0f-8ba7-088f3f9bebd2" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-178cb32d-791f-4a0f-8ba7-088f3f9bebd2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] Deleting offline snapshot 178cb32d-791f-4a0f-8ba7-088f3f9bebd2 of volume d6f256c4-1220-4701-872b-2e5f7a0dc942 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:54:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] snapshot_file for this snap is: volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:54:33 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b47ae10-789e-4ccf-a769-704a137ba5dd]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:33 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2 Jul 06 20:54:33 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:34 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64" returned: 0 in 0.756s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:54:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5dab02c-a418-42ac-8896-7d396a6428d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4751a39b-cd5a-42dd-845d-af7931ce7789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:34 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Volume volume-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64 (3075efc7-9be4-4c7f-a2c9-7348d4b8eb64): created successfully Jul 06 20:54:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4751a39b-cd5a-42dd-845d-af7931ce7789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Flow 'volume_create_manager' (ca5da9a8-8edc-4dad-b2ee-f9d42f704893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:54:34 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-72fbdc6b-90e9-4b72-b365-670fbf1df738 tempest-VolumesNegativeTest-192503420 None] Created volume successfully. Jul 06 20:54:34 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2" returned: 0 in 1.090s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6f256c4-1220-4701-872b-2e5f7a0dc942(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:54:34 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9ace66-dd10-4ab2-9fb7-8582403c338a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:35 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942 Jul 06 20:54:35 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:35 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942" returned: 0 in 0.971s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:35 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2 Jul 06 20:54:35 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:36 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2" returned: 0 in 0.822s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:36 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2 Jul 06 20:54:36 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:37 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942.178cb32d-791f-4a0f-8ba7-088f3f9bebd2" returned: 0 in 0.829s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:37 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-178cb32d-791f-4a0f-8ba7-088f3f9bebd2" released by "_delete_snapshot" :: held 3.879s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:37 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-d6f256c4-1220-4701-872b-2e5f7a0dc942" released by "delete_snapshot" :: held 3.916s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:37 devstack cinder-volume[87207]: WARNING cinder.quota [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-793975611 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-793975611, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:54:37 devstack cinder-volume[87207]: WARNING cinder.quota [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-793975611 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-793975611, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:54:37 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] Created reservations ['90ebc3b0-4c0c-4585-9ac7-a52ccc480909', '3ff3755d-e145-4683-92e5-5c6259652747', '778e3bad-2ceb-480a-83b2-46de1863ad24', '27542bca-5a49-4711-b880-70aa341af5d0'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:37 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-066994e0-d5e0-4411-9b71-ba6dfd2499ec tempest-GroupSnapshotsTest-1634452977 None] group_snapshot 6f8d2f6a-2cc3-4ca8-895c-8ba54c3a51ab: deleted successfully Jul 06 20:54:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "cinder-quobyte-d6f256c4-1220-4701-872b-2e5f7a0dc942" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-d6f256c4-1220-4701-872b-2e5f7a0dc942" acquired by "delete_volume" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:38 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95b34ec-b576-48fa-bf17-60cbcd0efb06]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:38 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942 Jul 06 20:54:38 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:38 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-65ed38aa-3379-479e-a72d-7a0bd97e43e3 tempest-GroupsV314Test-805141715 None] Group tempest-GroupsV314Test-Group-608377877: creating Jul 06 20:54:38 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-65ed38aa-3379-479e-a72d-7a0bd97e43e3 tempest-GroupsV314Test-805141715 None] Group tempest-GroupsV314Test-Group-608377877: created successfully Jul 06 20:54:38 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-65ed38aa-3379-479e-a72d-7a0bd97e43e3 tempest-GroupsV314Test-805141715 None] Create group completed successfully. Jul 06 20:54:39 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942" returned: 0 in 0.912s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:39 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942 Jul 06 20:54:39 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:40 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d6f256c4-1220-4701-872b-2e5f7a0dc942" returned: 0 in 0.730s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] Lock "cinder-quobyte-d6f256c4-1220-4701-872b-2e5f7a0dc942" released by "delete_volume" :: held 1.716s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] Created reservations ['124d3ed8-d93a-4e5c-aa34-443bffce93f2'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:40 devstack cinder-volume[87207]: WARNING cinder.quota [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-793975611 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-793975611, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] Created reservations ['2141d004-7e97-4e14-9674-d836960906ed', '641d77ae-67f6-4c1a-a13a-016b6424fe24', '23e9eba8-b748-43d7-99ad-29d820c79030', '8408cbd5-a793-4405-9dc1-f27cd11733b1'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Flow 'volume_create_manager' (5200bdac-90b4-4cb6-b203-fc6b827b4962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98346188-a8f4-48e0-a830-6171536cd977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98346188-a8f4-48e0-a830-6171536cd977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-206685098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=37e6e7e5-a01b-453e-8893-f309bc71b18e,host='devstack@QuobyteHD#QuobyteHD',id=0eb8c5db-8d35-4996-a5b6-9fb3455f50d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e122856be6497d8f2a92d2c4a1b1ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:40Z,use_quota=True,user_id='8bfafa2814974b9d90e4d637a5b6a5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8fb40e7-5254-467b-a52c-320c01b00bac),volume_type_id=c8fb40e7-5254-467b-a52c-320c01b00bac)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30462c06-5f02-4587-a0b3-d61629a0f47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30462c06-5f02-4587-a0b3-d61629a0f47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde17296-6e60-48d0-8c51-80e139ddd045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde17296-6e60-48d0-8c51-80e139ddd045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eb8c5db-8d35-4996-a5b6-9fb3455f50d7', 'volume_name': 'volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2734581e-6191-4569-b936-3c1e85d88cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2734581e-6191-4569-b936-3c1e85d88cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c5efdf-9f66-4cb5-9e89-ce37e74be001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:40 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Volume 0eb8c5db-8d35-4996-a5b6-9fb3455f50d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7', 'volume_size': 1} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=37e6e7e5-a01b-453e-8893-f309bc71b18e,created_at=2026-07-06T18:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-206685098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=37e6e7e5-a01b-453e-8893-f309bc71b18e,host='devstack@QuobyteHD#QuobyteHD',id=0eb8c5db-8d35-4996-a5b6-9fb3455f50d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e122856be6497d8f2a92d2c4a1b1ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:40Z,use_quota=True,user_id='8bfafa2814974b9d90e4d637a5b6a5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8fb40e7-5254-467b-a52c-320c01b00bac),volume_type_id=c8fb40e7-5254-467b-a52c-320c01b00bac)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Creating volume 0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:54:40 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:40 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 1073741824 Jul 06 20:54:40 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:40 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:54:40 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:54:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Flow 'volume_create_manager' (ef556246-f3d3-40b6-a3cf-09dc4f75483c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:54:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9711af-f565-47b3-ae7d-17f5af946eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9711af-f565-47b3-ae7d-17f5af946eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf1d7600-d478-4374-9af8-fbdbe069e8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34f360e8b1b84b558eb0d3e3df3d18e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:41Z,use_quota=True,user_id='9f20e7875d1f4f83b8a1e335fb971a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f65808d9-36b4-490a-ab84-4e704481e881),volume_type_id=f65808d9-36b4-490a-ab84-4e704481e881)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9887616-f740-46d2-a9b1-dc78982f0acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9887616-f740-46d2-a9b1-dc78982f0acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61af5d62-ebc2-4da6-ad2d-b41bb11528fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:41 devstack cinder-volume[87207]: DEBUG cinder.image.glance [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Creating Keystone auth plugin from conf {{(pid=87207) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 20:54:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61af5d62-ebc2-4da6-ad2d-b41bb11528fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bf1d7600-d478-4374-9af8-fbdbe069e8b7', 'volume_name': 'volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7', 'volume_size': 1, 'image_id': '73c1528b-bfa5-445b-9a74-6252aa94c7e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73c1528b-bfa5-445b-9a74-6252aa94c7e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '50876a5525824a11993ed0a8c7d46198', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34f360e8b1b84b558eb0d3e3df3d18e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e8c0d91d961fccd5d2b076b5d051c909aaa1dd03a29f883b745c8f3794fd5647699943324803ab89861e38399728ba3ff0430b5ebac077b36537ec73bca6e914', 'id': '73c1528b-bfa5-445b-9a74-6252aa94c7e4', 'created_at': datetime.datetime(2026, 7, 6, 18, 54, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 54, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73c1528b-bfa5-445b-9a74-6252aa94c7e4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2599b3b7-0bb4-42e4-ab5f-f38b859c0841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:41 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2599b3b7-0bb4-42e4-ab5f-f38b859c0841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45b2116-57ea-4892-bf46-beae10365ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:41 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Volume bf1d7600-d478-4374-9af8-fbdbe069e8b7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7', 'volume_size': 1, 'image_id': '73c1528b-bfa5-445b-9a74-6252aa94c7e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73c1528b-bfa5-445b-9a74-6252aa94c7e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '50876a5525824a11993ed0a8c7d46198', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34f360e8b1b84b558eb0d3e3df3d18e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e8c0d91d961fccd5d2b076b5d051c909aaa1dd03a29f883b745c8f3794fd5647699943324803ab89861e38399728ba3ff0430b5ebac077b36537ec73bca6e914', 'id': '73c1528b-bfa5-445b-9a74-6252aa94c7e4', 'created_at': datetime.datetime(2026, 7, 6, 18, 54, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 54, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73c1528b-bfa5-445b-9a74-6252aa94c7e4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 06 20:54:41 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Trying to clone bf1d7600-d478-4374-9af8-fbdbe069e8b7 from image 73c1528b-bfa5-445b-9a74-6252aa94c7e4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/73c1528b-bfa5-445b-9a74-6252aa94c7e4', 'metadata': {}}]). {{(pid=87207) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 20:54:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.011s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:41 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:54:41 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0409b750-ea9a-4bac-8e13-7ab61b446a63 tempest-GroupSnapshotsTest-1634452977 None] Delete group completed successfully. Jul 06 20:54:41 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 20:54:41 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Image download 0.00 MB at 0.00 MB/s Jul 06 20:54:41 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 1073741824" returned: 0 in 1.325s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:41 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a684461b-e269-4f58-ac2b-1bf2f0deab49]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:41 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 Jul 06 20:54:41 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:42 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD Jul 06 20:54:42 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:42 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7" returned: 0 in 0.768s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] <== create_volume: return (2217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:54:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.220s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c5efdf-9f66-4cb5-9e89-ce37e74be001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37e0249-d658-4536-acfb-d6f338b1ba08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:42 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Volume volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 (0eb8c5db-8d35-4996-a5b6-9fb3455f50d7): created successfully Jul 06 20:54:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37e0249-d658-4536-acfb-d6f338b1ba08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Flow 'volume_create_manager' (5200bdac-90b4-4cb6-b203-fc6b827b4962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:54:42 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-2f289347-1ef8-4efa-acbc-74ed30690051 tempest-GroupsV314Test-805141715 None] Created volume successfully. Jul 06 20:54:43 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD" returned: 0 in 1.212s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:43 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD Jul 06 20:54:43 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:44 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD" returned: 1 in 0.898s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:54:44 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Temporary image 73c1528b-bfa5-445b-9a74-6252aa94c7e4 is fetched for user 9f20e7875d1f4f83b8a1e335fb971a67. {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 20:54:44 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=187,cinder:UPDATE=196,cinder:INSERT=56,cinder:DELETE=11 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:54:44 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:UPDATE=216,cinder:INSERT=49,cinder:SELECT=181,cinder:DELETE=10 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:54:44 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac07ff06-cdd7-4205-b849-f53ad511cc86]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:44 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD Jul 06 20:54:44 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:44 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Cloning volume 0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 to volume 5220e93f-8b03-4b1b-832f-9f9177c53896 Jul 06 20:54:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Creating offline snapshot 4a2cf623-00b1-4e76-9782-0b853c3a26da of volume 0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:54:44 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49aa7e2-26d0-4e26-92e7-ecbe8a98fbf1]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:44 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 Jul 06 20:54:44 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:45 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD" returned: 0 in 1.107s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:45 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD Jul 06 20:54:45 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:45 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7" returned: 0 in 1.041s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:45 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da 1G Jul 06 20:54:45 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:46 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD" returned: 1 in 0.777s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:54:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:46 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da 1G" returned: 0 in 0.933s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:46 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da Jul 06 20:54:46 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:47 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da" returned: 0 in 0.725s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:47 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da is being set with open permissions: ugo+rw: NotImplementedError Jul 06 20:54:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:47 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da Jul 06 20:54:47 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:48 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da" returned: 0 in 0.708s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:48 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.info Jul 06 20:54:48 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:49 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.info" returned: 0 in 0.985s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:49 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 20:54:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:49 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.info Jul 06 20:54:49 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:49 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.info" returned: 0 in 0.753s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Acquiring lock "cinder-quobyte-5220e93f-8b03-4b1b-832f-9f9177c53896" by "_copy_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:54:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Lock "cinder-quobyte-5220e93f-8b03-4b1b-832f-9f9177c53896" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:54:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] snapshot: 4a2cf623-00b1-4e76-9782-0b853c3a26da, volume: 5220e93f-8b03-4b1b-832f-9f9177c53896, {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 20:54:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:50 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ceada8-ee42-4cfd-8d9e-7a315b7f12b0]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:50 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da Jul 06 20:54:50 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:51 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da" returned: 0 in 0.973s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:54:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 20:54:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Creating direct copy from snapshot {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 20:54:51 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f950a1-873f-4eef-a985-c8ce4f988d06]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:51 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 Jul 06 20:54:51 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:52 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7" returned: 0 in 1.089s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:52 devstack cinder-volume[87207]: DEBUG cinder.utils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Path /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5220e93f-8b03-4b1b-832f-9f9177c53896 not found in is_blk_device check {{(pid=87207) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 20:54:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5220e93f-8b03-4b1b-832f-9f9177c53896 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:52 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5220e93f-8b03-4b1b-832f-9f9177c53896 Jul 06 20:54:52 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:57 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:54:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Flow 'volume_create_manager' (443e31e2-1aee-48eb-bdbc-db59dabda4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:54:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1eef55-4a51-46d2-962e-292a13fa0851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1eef55-4a51-46d2-962e-292a13fa0851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-240886194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73936eb-6de1-4790-83b6-f1f34031d9a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d747440bf7574efa895f5e7f481039b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:57Z,use_quota=True,user_id='581d93acc7fb4277945c386b2ddafa5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b7f0075-9b5e-4ae0-9761-734e8252afef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b7f0075-9b5e-4ae0-9761-734e8252afef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19efe07-f6e9-46d9-bacd-4eaaa9e525b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19efe07-f6e9-46d9-bacd-4eaaa9e525b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b73936eb-6de1-4790-83b6-f1f34031d9a7', 'volume_name': 'volume-b73936eb-6de1-4790-83b6-f1f34031d9a7', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c0fb6e-428b-469f-aa71-6df9e75488c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c0fb6e-428b-469f-aa71-6df9e75488c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:54:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe0e8cd-ffcd-4069-a54c-e7de925e6493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:54:57 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Volume b73936eb-6de1-4790-83b6-f1f34031d9a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b73936eb-6de1-4790-83b6-f1f34031d9a7', 'volume_size': 1} Jul 06 20:54:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:57 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:54:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:54:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:54:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:54:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:54:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:54:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:58 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:54:58 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:58 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5220e93f-8b03-4b1b-832f-9f9177c53896" returned: 0 in 6.652s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:58 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87505a0-ea36-4e62-a450-b05e06030caf]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:54:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:58 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 Jul 06 20:54:58 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:54:59 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.170s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:59 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:54:59 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:54:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:54:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:54:59 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 06 20:54:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7" returned: 0 in 0.944s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:54:59 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Image conversion details: src /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5220e93f-8b03-4b1b-832f-9f9177c53896 {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 20:54:59 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Converted 1024.00 MB image at 153.92 MB/s Jul 06 20:54:59 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5220e93f-8b03-4b1b-832f-9f9177c53896 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 20:54:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5220e93f-8b03-4b1b-832f-9f9177c53896 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:54:59 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5220e93f-8b03-4b1b-832f-9f9177c53896 Jul 06 20:54:59 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:00 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5220e93f-8b03-4b1b-832f-9f9177c53896" returned: 0 in 0.616s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Lock "cinder-quobyte-5220e93f-8b03-4b1b-832f-9f9177c53896" released by "_copy_volume_from_snapshot" :: held 10.395s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Acquiring lock "cinder-quobyte-4a2cf623-00b1-4e76-9782-0b853c3a26da" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Lock "cinder-quobyte-4a2cf623-00b1-4e76-9782-0b853c3a26da" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Deleting offline snapshot 4a2cf623-00b1-4e76-9782-0b853c3a26da of volume 0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:55:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] snapshot_file for this snap is: volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:55:00 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb56837b-1472-4b3e-b45e-528e171eb0f6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:00 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da Jul 06 20:55:00 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:01 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da" returned: 0 in 0.842s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:55:01 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c09b537-4cf3-4d8e-bb99-7dd0e0195c55]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:01 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 Jul 06 20:55:01 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:02 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7" returned: 0 in 0.892s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:02 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da Jul 06 20:55:02 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:03 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da" returned: 0 in 0.786s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:03 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da Jul 06 20:55:03 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:03 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7.4a2cf623-00b1-4e76-9782-0b853c3a26da" returned: 0 in 0.742s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Lock "cinder-quobyte-4a2cf623-00b1-4e76-9782-0b853c3a26da" released by "_delete_snapshot" :: held 3.368s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.259s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.790s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf1d7600-d478-4374-9af8-fbdbe069e8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34f360e8b1b84b558eb0d3e3df3d18e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:41Z,use_quota=True,user_id='9f20e7875d1f4f83b8a1e335fb971a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f65808d9-36b4-490a-ab84-4e704481e881),volume_type_id=f65808d9-36b4-490a-ab84-4e704481e881)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:55:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Creating volume bf1d7600-d478-4374-9af8-fbdbe069e8b7 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:55:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:55:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:55:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:55:03 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:55:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:03 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 1073741824 Jul 06 20:55:03 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:03 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-23dfcb63-4e9c-4f80-9204-ce6dd3f7f418 tempest-GroupsV314Test-805141715 None] Create group from source-group-37e6e7e5-a01b-453e-8893-f309bc71b18e completed successfully. Jul 06 20:55:04 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 1073741824" returned: 0 in 0.933s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:04 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 Jul 06 20:55:04 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] Acquiring lock "cinder-quobyte-5220e93f-8b03-4b1b-832f-9f9177c53896" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] Lock "cinder-quobyte-5220e93f-8b03-4b1b-832f-9f9177c53896" acquired by "delete_volume" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[799ed559-d2d8-4bca-a147-37ad31e865d5]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5220e93f-8b03-4b1b-832f-9f9177c53896 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:05 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5220e93f-8b03-4b1b-832f-9f9177c53896 Jul 06 20:55:05 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:05 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7" returned: 0 in 0.854s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.350s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-240886194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73936eb-6de1-4790-83b6-f1f34031d9a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d747440bf7574efa895f5e7f481039b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:57Z,use_quota=True,user_id='581d93acc7fb4277945c386b2ddafa5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Creating volume b73936eb-6de1-4790-83b6-f1f34031d9a7 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:55:05 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:05 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7 1073741824 Jul 06 20:55:05 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Attempting download of 73c1528b-bfa5-445b-9a74-6252aa94c7e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/73c1528b-bfa5-445b-9a74-6252aa94c7e4', 'metadata': {}}])) to volume bf1d7600-d478-4374-9af8-fbdbe069e8b7. {{(pid=87207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc28b15-f8cc-4528-8c8a-cb05d02ae9ef]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73c1528b-bfa5-445b-9a74-6252aa94c7e4_q4zkpcf4 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:05 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5220e93f-8b03-4b1b-832f-9f9177c53896" returned: 0 in 0.825s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5220e93f-8b03-4b1b-832f-9f9177c53896 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:05 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5220e93f-8b03-4b1b-832f-9f9177c53896 Jul 06 20:55:05 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:05 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73c1528b-bfa5-445b-9a74-6252aa94c7e4_q4zkpcf4 Jul 06 20:55:05 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:06 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73c1528b-bfa5-445b-9a74-6252aa94c7e4_q4zkpcf4" returned: 0 in 0.960s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73c1528b-bfa5-445b-9a74-6252aa94c7e4_q4zkpcf4 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:06 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7 1073741824" returned: 0 in 1.094s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:06 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5220e93f-8b03-4b1b-832f-9f9177c53896" returned: 0 in 0.905s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] Lock "cinder-quobyte-5220e93f-8b03-4b1b-832f-9f9177c53896" released by "delete_volume" :: held 1.800s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:06 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7 Jul 06 20:55:06 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:06 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73c1528b-bfa5-445b-9a74-6252aa94c7e4_q4zkpcf4 Jul 06 20:55:06 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:06 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] Created reservations ['a4333082-3983-47a6-b91d-d40ef8a27bc2'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:55:06 devstack cinder-volume[87207]: WARNING cinder.quota [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-852538487 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-852538487, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:55:06 devstack cinder-volume[87207]: WARNING cinder.quota [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-852538487 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-852538487, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] Created reservations ['d6bd15d0-46e8-41af-aaec-2a1e5d13cd0e', '95d5a764-1246-4d92-b2c1-b74722528b6f', '99fd6609-12d5-4ceb-9ba3-b32e3a2d927e', '5552b7ae-2999-4ceb-902f-e93d39e1ab0a'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:07 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:55:07 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:07 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7" returned: 0 in 0.982s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] <== create_volume: return (2163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe0e8cd-ffcd-4069-a54c-e7de925e6493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b73936eb-6de1-4790-83b6-f1f34031d9a7', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f024ed5-f394-401b-97a9-6e134fbc7d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:07 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Volume volume-b73936eb-6de1-4790-83b6-f1f34031d9a7 (b73936eb-6de1-4790-83b6-f1f34031d9a7): created successfully Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f024ed5-f394-401b-97a9-6e134fbc7d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Flow 'volume_create_manager' (443e31e2-1aee-48eb-bdbc-db59dabda4c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:55:07 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-62950431-03cf-4cad-8140-c9a82f2a7c00 tempest-SnapshotsActionsTest-793060599 None] Created volume successfully. Jul 06 20:55:07 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73c1528b-bfa5-445b-9a74-6252aa94c7e4_q4zkpcf4" returned: 1 in 1.187s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73c1528b-bfa5-445b-9a74-6252aa94c7e4_q4zkpcf4' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0f8ca8-17cb-4778-9826-b82c37ffb64a]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9874a72a-ec5d-405e-a22f-9ea50cf3660e tempest-GroupsV314Test-805141715 None] Acquiring lock "cinder-quobyte-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9874a72a-ec5d-405e-a22f-9ea50cf3660e tempest-GroupsV314Test-805141715 None] Lock "cinder-quobyte-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7" acquired by "delete_volume" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:08 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0189e5e0-2287-4916-91fa-ca7c98cdf6cf]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9874a72a-ec5d-405e-a22f-9ea50cf3660e tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:08 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD Jul 06 20:55:08 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:08 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 Jul 06 20:55:08 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:08 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.053s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:08 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:55:08 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0e9b84c4-9e74-4b95-9d89-684d0e6c5ac7 tempest-GroupsV314Test-805141715 None] Delete group completed successfully. Jul 06 20:55:08 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD" returned: 0 in 0.930s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:08 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9874a72a-ec5d-405e-a22f-9ea50cf3660e tempest-GroupsV314Test-805141715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7" returned: 0 in 0.862s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9874a72a-ec5d-405e-a22f-9ea50cf3660e tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:08 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7 Jul 06 20:55:08 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] Creating offline snapshot 1a16f67a-f031-4cb1-8e75-07736daf2f89 of volume b73936eb-6de1-4790-83b6-f1f34031d9a7 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:55:09 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD Jul 06 20:55:09 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:09 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbba8be6-1193-423a-a9c4-ef2ca66a4596]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:09 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7 Jul 06 20:55:09 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:09 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9874a72a-ec5d-405e-a22f-9ea50cf3660e tempest-GroupsV314Test-805141715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7" returned: 0 in 0.832s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:09 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9874a72a-ec5d-405e-a22f-9ea50cf3660e tempest-GroupsV314Test-805141715 None] Lock "cinder-quobyte-0eb8c5db-8d35-4996-a5b6-9fb3455f50d7" released by "delete_volume" :: held 1.823s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:09 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD" returned: 1 in 0.988s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:55:09 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] 73c1528b-bfa5-445b-9a74-6252aa94c7e4 was raw, converting to raw {{(pid=87207) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 20:55:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:09 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 Jul 06 20:55:09 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:09 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-9874a72a-ec5d-405e-a22f-9ea50cf3660e tempest-GroupsV314Test-805141715 None] Created reservations ['27584b8e-cb0f-4170-9b26-6ca5e4c4fd53'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:55:10 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-9874a72a-ec5d-405e-a22f-9ea50cf3660e tempest-GroupsV314Test-805141715 None] Created reservations ['f80ed2e7-b0a1-482b-90c8-2a6d1306e012', '72956dcd-3784-4895-b790-9a37bb2ba522', '3281fff2-6cef-4376-96ee-533d255d1c2c', '62493b16-5b21-4883-83a8-e87e47bc0439'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:55:10 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7" returned: 0 in 1.073s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:10 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 1G Jul 06 20:55:10 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9874a72a-ec5d-405e-a22f-9ea50cf3660e tempest-GroupsV314Test-805141715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9874a72a-ec5d-405e-a22f-9ea50cf3660e tempest-GroupsV314Test-805141715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9874a72a-ec5d-405e-a22f-9ea50cf3660e tempest-GroupsV314Test-805141715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:55:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9874a72a-ec5d-405e-a22f-9ea50cf3660e tempest-GroupsV314Test-805141715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:55:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9874a72a-ec5d-405e-a22f-9ea50cf3660e tempest-GroupsV314Test-805141715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9874a72a-ec5d-405e-a22f-9ea50cf3660e tempest-GroupsV314Test-805141715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:10 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:55:10 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:11 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7" returned: 0 in 1.154s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:11 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_73c1528b-bfa5-445b-9a74-6252aa94c7e4_48tj5n4hdevstack@QuobyteHD, size 0.00 MB, duration 1.16 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 20:55:11 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 20:55:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:11 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 1G Jul 06 20:55:11 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] Acquiring lock "cinder-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] Lock "cinder-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] Acquiring lock "cinder-quobyte-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] Lock "cinder-quobyte-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64" acquired by "delete_volume" :: waited 0.024s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:11 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[350fef7d-d9ad-4792-8ebc-65cc83ba5222]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:11 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9874a72a-ec5d-405e-a22f-9ea50cf3660e tempest-GroupsV314Test-805141715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.136s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:11 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-9874a72a-ec5d-405e-a22f-9ea50cf3660e tempest-GroupsV314Test-805141715 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:55:11 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9874a72a-ec5d-405e-a22f-9ea50cf3660e tempest-GroupsV314Test-805141715 None] Delete group completed successfully. Jul 06 20:55:11 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 1G" returned: 0 in 1.357s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73936eb-6de1-4790-83b6-f1f34031d9a7 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:11 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73936eb-6de1-4790-83b6-f1f34031d9a7 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 Jul 06 20:55:11 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:11 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64 Jul 06 20:55:11 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:12 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 1G" returned: 0 in 1.002s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:12 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[64090302-4035-4b9f-900b-a9cafae1ab5a]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:12 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 Jul 06 20:55:12 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:12 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73936eb-6de1-4790-83b6-f1f34031d9a7 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89" returned: 0 in 0.891s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:12 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 is being set with open permissions: ugo+rw Jul 06 20:55:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:12 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 Jul 06 20:55:12 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:12 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64" returned: 0 in 1.095s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:12 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64 Jul 06 20:55:12 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:13 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7" returned: 0 in 1.088s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:13 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89" returned: 0 in 0.844s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:13 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64" returned: 0 in 0.819s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:13 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] Lock "cinder-quobyte-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64" released by "delete_volume" :: held 2.001s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:13 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.info Jul 06 20:55:13 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:13 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 Jul 06 20:55:13 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:13 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] Created reservations ['d0cbfeec-4eed-4541-ad1a-36b4c0810f6c', '94fd623d-0483-4eb3-a6cc-2abc6129bdf5', '8f980d5c-7c54-48a7-8e05-e282f260bbe5', 'd76bf5a1-2cd2-41c3-ad18-7a3aab1ba518'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:55:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:55:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:55:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:13 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:55:13 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:14 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.info" returned: 0 in 0.985s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:14 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.info is being set with open permissions: ugo+rw Jul 06 20:55:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:14 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.info Jul 06 20:55:14 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:14 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7" returned: 1 in 1.139s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:55:14 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Downloaded image 73c1528b-bfa5-445b-9a74-6252aa94c7e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/73c1528b-bfa5-445b-9a74-6252aa94c7e4', 'metadata': {}}])) to volume bf1d7600-d478-4374-9af8-fbdbe069e8b7 successfully. {{(pid=87207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 20:55:14 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Temporary image 73c1528b-bfa5-445b-9a74-6252aa94c7e4 for user 9f20e7875d1f4f83b8a1e335fb971a67 is deleted. {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 20:55:14 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Marking volume bf1d7600-d478-4374-9af8-fbdbe069e8b7 as bootable. {{(pid=87207) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 20:55:14 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Copying metadata from image 73c1528b-bfa5-445b-9a74-6252aa94c7e4 to bf1d7600-d478-4374-9af8-fbdbe069e8b7. {{(pid=87207) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 20:55:14 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Creating volume glance metadata for volume bf1d7600-d478-4374-9af8-fbdbe069e8b7 backed by image 73c1528b-bfa5-445b-9a74-6252aa94c7e4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '73c1528b-bfa5-445b-9a74-6252aa94c7e4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '50876a5525824a11993ed0a8c7d46198', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87207) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 20:55:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45b2116-57ea-4892-bf46-beae10365ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7', 'volume_size': 1, 'image_id': '73c1528b-bfa5-445b-9a74-6252aa94c7e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73c1528b-bfa5-445b-9a74-6252aa94c7e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '50876a5525824a11993ed0a8c7d46198', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34f360e8b1b84b558eb0d3e3df3d18e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e8c0d91d961fccd5d2b076b5d051c909aaa1dd03a29f883b745c8f3794fd5647699943324803ab89861e38399728ba3ff0430b5ebac077b36537ec73bca6e914', 'id': '73c1528b-bfa5-445b-9a74-6252aa94c7e4', 'created_at': datetime.datetime(2026, 7, 6, 18, 54, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 54, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73c1528b-bfa5-445b-9a74-6252aa94c7e4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d096146-26e9-49d4-b513-1864e4eef1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:14 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Volume volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 (bf1d7600-d478-4374-9af8-fbdbe069e8b7): created successfully Jul 06 20:55:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d096146-26e9-49d4-b513-1864e4eef1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Flow 'volume_create_manager' (ef556246-f3d3-40b6-a3cf-09dc4f75483c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:55:14 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-4c2d1d98-e4a7-48b0-aa62-8ca9478b88b7 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Created volume successfully. Jul 06 20:55:14 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.138s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:14 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:55:14 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] Deleted volume successfully. Jul 06 20:55:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-81eeffee-f159-4866-a8e3-b7df0cd9abae tempest-VolumesNegativeTest-192503420 None] Lock "cinder-3075efc7-9be4-4c7f-a2c9-7348d4b8eb64-delete_volume" released by "delete_volume" :: held 3.410s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:15 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.info" returned: 0 in 0.810s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.079s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:15 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-43f03f9c-c414-4155-86a5-cacf2efa5630 tempest-SnapshotsActionsTest-793060599 None] Create snapshot completed successfully Jul 06 20:55:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Acquiring lock "cinder-bf1d7600-d478-4374-9af8-fbdbe069e8b7-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Lock "cinder-bf1d7600-d478-4374-9af8-fbdbe069e8b7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Acquiring lock "cinder-quobyte-bf1d7600-d478-4374-9af8-fbdbe069e8b7" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Lock "cinder-quobyte-bf1d7600-d478-4374-9af8-fbdbe069e8b7" acquired by "delete_volume" :: waited 0.030s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:15 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f0ab90-cca3-4cba-9ab3-659621654b97]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:15 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 Jul 06 20:55:15 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f96af4db-a87b-4f4c-bcad-d63122e3e355 tempest-SnapshotsActionsTest-793060599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f96af4db-a87b-4f4c-bcad-d63122e3e355 tempest-SnapshotsActionsTest-793060599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f96af4db-a87b-4f4c-bcad-d63122e3e355 tempest-SnapshotsActionsTest-793060599 None] Creating offline snapshot 3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6 of volume b73936eb-6de1-4790-83b6-f1f34031d9a7 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:55:16 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:16 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f036aa-249f-49c1-9bf8-beb56eea4d50]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f96af4db-a87b-4f4c-bcad-d63122e3e355 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7" returned: 0 in 0.901s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:16 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 Jul 06 20:55:16 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:16 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 Jul 06 20:55:16 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:17 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7" returned: 1 in 0.912s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:55:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:17 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:17 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7 Jul 06 20:55:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f96af4db-a87b-4f4c-bcad-d63122e3e355 tempest-SnapshotsActionsTest-793060599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89" returned: 0 in 0.960s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:17 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:17 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f96af4db-a87b-4f4c-bcad-d63122e3e355 tempest-SnapshotsActionsTest-793060599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73936eb-6de1-4790-83b6-f1f34031d9a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:55:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f96af4db-a87b-4f4c-bcad-d63122e3e355 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:17 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6 1G Jul 06 20:55:17 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:17 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bf1d7600-d478-4374-9af8-fbdbe069e8b7" returned: 0 in 0.726s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Lock "cinder-quobyte-bf1d7600-d478-4374-9af8-fbdbe069e8b7" released by "delete_volume" :: held 2.623s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:18 devstack cinder-volume[87207]: WARNING cinder.quota [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:55:18 devstack cinder-volume[87207]: WARNING cinder.quota [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:55:18 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Created reservations ['d3902481-b421-49a4-a131-48933565ac93', '5f7fa230-b3f7-41e5-a242-98ce5515fa2c', '8b9ef066-3584-4373-b876-7afe4f60a934', '3de74602-6f64-4176-b682-9166a654f8c1'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:55:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:55:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:55:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:18 devstack sudo[98393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:55:18 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:18 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f96af4db-a87b-4f4c-bcad-d63122e3e355 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6 1G" returned: 0 in 1.260s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f96af4db-a87b-4f4c-bcad-d63122e3e355 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:18 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6 Jul 06 20:55:18 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:19 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.934s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:19 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:55:19 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Deleted volume successfully. Jul 06 20:55:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bca40803-ec7d-43ae-8ab6-83f8e1f73da0 tempest-VolumeAndVolumeTypeFromImageTest-141273734 None] Lock "cinder-bf1d7600-d478-4374-9af8-fbdbe069e8b7-delete_volume" released by "delete_volume" :: held 4.047s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:19 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f96af4db-a87b-4f4c-bcad-d63122e3e355 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6" returned: 0 in 1.002s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:19 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-f96af4db-a87b-4f4c-bcad-d63122e3e355 tempest-SnapshotsActionsTest-793060599 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6 is being set with open permissions: ugo+rw Jul 06 20:55:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f96af4db-a87b-4f4c-bcad-d63122e3e355 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:19 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6 Jul 06 20:55:19 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:20 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f96af4db-a87b-4f4c-bcad-d63122e3e355 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6" returned: 0 in 0.750s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f96af4db-a87b-4f4c-bcad-d63122e3e355 tempest-SnapshotsActionsTest-793060599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.114s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:20 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f96af4db-a87b-4f4c-bcad-d63122e3e355 tempest-SnapshotsActionsTest-793060599 None] Create snapshot completed successfully Jul 06 20:55:21 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] Acquiring lock "cinder-3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:21 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:21 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] Acquiring lock "cinder-quobyte-b73936eb-6de1-4790-83b6-f1f34031d9a7" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:21 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-quobyte-b73936eb-6de1-4790-83b6-f1f34031d9a7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:21 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] Acquiring lock "cinder-quobyte-3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:21 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-quobyte-3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] Deleting offline snapshot 3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6 of volume b73936eb-6de1-4790-83b6-f1f34031d9a7 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:55:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] snapshot_file for this snap is: volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:55:21 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e3b0db-5fac-4053-98f2-3de09b48d0d6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:21 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6 Jul 06 20:55:21 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:22 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6" returned: 0 in 0.930s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73936eb-6de1-4790-83b6-f1f34031d9a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:55:22 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6176ebb3-d088-4e61-9e54-f6e1bf6081d3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:22 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 Jul 06 20:55:22 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:23 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89" returned: 0 in 0.986s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73936eb-6de1-4790-83b6-f1f34031d9a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:55:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:23 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6 Jul 06 20:55:23 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:24 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6" returned: 0 in 1.098s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:24 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6 Jul 06 20:55:24 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:25 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6" returned: 0 in 0.992s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:25 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-quobyte-3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6" released by "_delete_snapshot" :: held 4.181s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:25 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-quobyte-b73936eb-6de1-4790-83b6-f1f34031d9a7" released by "delete_snapshot" :: held 4.233s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:26 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] Created reservations ['d14ba824-86fb-4ddf-87f4-6b5c89a9451e', 'cd306ed6-cfc2-469e-b629-90d477e62529', 'b8e8c613-a237-4a6f-9cfe-0250a19e33d9', '346afe24-3d0a-44d4-9db8-19b5880cdd45'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:55:26 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] Delete snapshot completed successfully. Jul 06 20:55:26 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-777d2af5-0441-4a1a-ac78-ba4f51c9ff18 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-3ee0ec4c-2d8b-48d2-8a44-58a9700fe4d6-delete_snapshot" released by "delete_snapshot" :: held 4.493s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Flow 'volume_create_manager' (5b4ee609-ac8d-4e52-b31e-35031ada0312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5482ca5-9fbf-4b7b-b18e-871fb0544c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5482ca5-9fbf-4b7b-b18e-871fb0544c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1298737430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40477241-8ddf-4874-9a10-d911df58a1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd95fb50a704fecadbdffd1d6b4f8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:27Z,use_quota=True,user_id='f63d848f1a0a4e5e8e9238d694733d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63bce6c8-8603-4002-88a7-19c34386e934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63bce6c8-8603-4002-88a7-19c34386e934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b77ab0c-f36e-4d38-9d52-9e766b4871fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b77ab0c-f36e-4d38-9d52-9e766b4871fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40477241-8ddf-4874-9a10-d911df58a1c6', 'volume_name': 'volume-40477241-8ddf-4874-9a10-d911df58a1c6', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701b3de5-540d-40af-8829-a7b4c3a0466e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701b3de5-540d-40af-8829-a7b4c3a0466e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb89267-d73c-418e-9411-c0fa06091d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:27 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Volume 40477241-8ddf-4874-9a10-d911df58a1c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40477241-8ddf-4874-9a10-d911df58a1c6', 'volume_size': 1} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1298737430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40477241-8ddf-4874-9a10-d911df58a1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd95fb50a704fecadbdffd1d6b4f8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:27Z,use_quota=True,user_id='f63d848f1a0a4e5e8e9238d694733d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Creating volume 40477241-8ddf-4874-9a10-d911df58a1c6 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:55:27 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40477241-8ddf-4874-9a10-d911df58a1c6 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:27 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40477241-8ddf-4874-9a10-d911df58a1c6 1073741824 Jul 06 20:55:27 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e0996ee7-cf39-4f10-bc26-3eec05876704 tempest-SnapshotsActionsTest-793060599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:28 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40477241-8ddf-4874-9a10-d911df58a1c6 1073741824" returned: 0 in 1.112s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40477241-8ddf-4874-9a10-d911df58a1c6 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:28 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40477241-8ddf-4874-9a10-d911df58a1c6 Jul 06 20:55:28 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:29 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40477241-8ddf-4874-9a10-d911df58a1c6" returned: 0 in 0.730s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:29 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:55:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e0996ee7-cf39-4f10-bc26-3eec05876704 tempest-SnapshotsActionsTest-793060599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.838s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb89267-d73c-418e-9411-c0fa06091d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40477241-8ddf-4874-9a10-d911df58a1c6', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ddfc373-ef13-455e-a9ea-86b46b937cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:29 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e0996ee7-cf39-4f10-bc26-3eec05876704 tempest-SnapshotsActionsTest-793060599 None] Creating offline snapshot 42716526-5304-4818-83e4-8820c3088a8d of volume b73936eb-6de1-4790-83b6-f1f34031d9a7 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:55:29 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Volume volume-40477241-8ddf-4874-9a10-d911df58a1c6 (40477241-8ddf-4874-9a10-d911df58a1c6): created successfully Jul 06 20:55:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ddfc373-ef13-455e-a9ea-86b46b937cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Flow 'volume_create_manager' (5b4ee609-ac8d-4e52-b31e-35031ada0312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:55:29 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[745f2582-c86b-4631-ab2b-1fc81c0fd3e7]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0996ee7-cf39-4f10-bc26-3eec05876704 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:29 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e5141bce-f99c-47c8-8621-a1e38f2551df tempest-ProjectReaderTests-254132344 None] Created volume successfully. Jul 06 20:55:29 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 Jul 06 20:55:29 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:30 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] Acquiring lock "cinder-40477241-8ddf-4874-9a10-d911df58a1c6-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:30 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] Lock "cinder-40477241-8ddf-4874-9a10-d911df58a1c6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:30 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] Acquiring lock "cinder-quobyte-40477241-8ddf-4874-9a10-d911df58a1c6" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:30 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] Lock "cinder-quobyte-40477241-8ddf-4874-9a10-d911df58a1c6" acquired by "delete_volume" :: waited 0.026s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:30 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4d4213-ed75-4deb-8018-08bba1823e90]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40477241-8ddf-4874-9a10-d911df58a1c6 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:30 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40477241-8ddf-4874-9a10-d911df58a1c6 Jul 06 20:55:30 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:30 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0996ee7-cf39-4f10-bc26-3eec05876704 tempest-SnapshotsActionsTest-793060599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89" returned: 0 in 1.078s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e0996ee7-cf39-4f10-bc26-3eec05876704 tempest-SnapshotsActionsTest-793060599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73936eb-6de1-4790-83b6-f1f34031d9a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:55:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0996ee7-cf39-4f10-bc26-3eec05876704 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:30 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d 1G Jul 06 20:55:30 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:31 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40477241-8ddf-4874-9a10-d911df58a1c6" returned: 0 in 0.904s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40477241-8ddf-4874-9a10-d911df58a1c6 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:31 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40477241-8ddf-4874-9a10-d911df58a1c6 Jul 06 20:55:31 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:31 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0996ee7-cf39-4f10-bc26-3eec05876704 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d 1G" returned: 0 in 1.077s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0996ee7-cf39-4f10-bc26-3eec05876704 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:31 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d Jul 06 20:55:31 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:31 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40477241-8ddf-4874-9a10-d911df58a1c6" returned: 0 in 0.795s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] Lock "cinder-quobyte-40477241-8ddf-4874-9a10-d911df58a1c6" released by "delete_volume" :: held 1.757s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:32 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] Created reservations ['d5d3db13-de48-4ef8-819b-ba74d47c8536', '37d67a99-878e-4391-9879-f5552ede7719', 'cb543f4a-d20b-487d-bc9f-b8ab4eba6903', 'bcf77afb-77ef-406e-aa51-6cc73db0ee2f'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:55:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:32 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:55:32 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:55:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:32 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:55:32 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:32 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0996ee7-cf39-4f10-bc26-3eec05876704 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d" returned: 0 in 0.838s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:32 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-e0996ee7-cf39-4f10-bc26-3eec05876704 tempest-SnapshotsActionsTest-793060599 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d is being set with open permissions: ugo+rw Jul 06 20:55:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0996ee7-cf39-4f10-bc26-3eec05876704 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:32 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d Jul 06 20:55:32 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:33 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.952s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:55:33 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] Deleted volume successfully. Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-48cd1ed3-dc11-46ad-87e6-b51706bde725 tempest-ProjectReaderTests-254132344 None] Lock "cinder-40477241-8ddf-4874-9a10-d911df58a1c6-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Flow 'volume_create_manager' (672dee59-6c42-4ccd-bee8-70319af18db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b46b77-aae5-4a6b-b9a3-5fea581154b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b46b77-aae5-4a6b-b9a3-5fea581154b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97834021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2745e840-5631-4086-81e8-4059f53848f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd95fb50a704fecadbdffd1d6b4f8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:33Z,use_quota=True,user_id='f63d848f1a0a4e5e8e9238d694733d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668b8ac7-a3a1-4a35-9adc-4663157d7e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668b8ac7-a3a1-4a35-9adc-4663157d7e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9bed3c5-0902-4f67-b3e6-ee1b9cd4416e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9bed3c5-0902-4f67-b3e6-ee1b9cd4416e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2745e840-5631-4086-81e8-4059f53848f3', 'volume_name': 'volume-2745e840-5631-4086-81e8-4059f53848f3', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697b9d3c-11d2-4ff9-8d10-3f54a3f25cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697b9d3c-11d2-4ff9-8d10-3f54a3f25cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b31c871-b153-4a80-922e-3e23469efca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:33 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Volume 2745e840-5631-4086-81e8-4059f53848f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2745e840-5631-4086-81e8-4059f53848f3', 'volume_size': 1} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:33 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0996ee7-cf39-4f10-bc26-3eec05876704 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d" returned: 0 in 0.867s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e0996ee7-cf39-4f10-bc26-3eec05876704 tempest-SnapshotsActionsTest-793060599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.028s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.063s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97834021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2745e840-5631-4086-81e8-4059f53848f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd95fb50a704fecadbdffd1d6b4f8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:33Z,use_quota=True,user_id='f63d848f1a0a4e5e8e9238d694733d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Creating volume 2745e840-5631-4086-81e8-4059f53848f3 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:55:33 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:55:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2745e840-5631-4086-81e8-4059f53848f3 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:33 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2745e840-5631-4086-81e8-4059f53848f3 1073741824 Jul 06 20:55:33 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:33 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e0996ee7-cf39-4f10-bc26-3eec05876704 tempest-SnapshotsActionsTest-793060599 None] Create snapshot completed successfully Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] Acquiring lock "cinder-42716526-5304-4818-83e4-8820c3088a8d-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-42716526-5304-4818-83e4-8820c3088a8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] Acquiring lock "cinder-quobyte-b73936eb-6de1-4790-83b6-f1f34031d9a7" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-quobyte-b73936eb-6de1-4790-83b6-f1f34031d9a7" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] Acquiring lock "cinder-quobyte-42716526-5304-4818-83e4-8820c3088a8d" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-quobyte-42716526-5304-4818-83e4-8820c3088a8d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] Deleting offline snapshot 42716526-5304-4818-83e4-8820c3088a8d of volume b73936eb-6de1-4790-83b6-f1f34031d9a7 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] snapshot_file for this snap is: volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0c86f0-f124-4996-8570-184de3629de8]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Flow 'volume_create_manager' (c0987dd9-b6eb-49c2-b229-2ead7e6c3005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991284f5-87a2-4c1b-98db-6ccd973a71e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991284f5-87a2-4c1b-98db-6ccd973a71e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-720023815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f9ffdc-505d-4bd3-8d53-daac10eaf238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b46095285546fb85fbbc4892e41204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:34Z,use_quota=True,user_id='53d92933936e4759a8ab13d7f8109239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6aa0296-0f51-4b49-b3e0-7b82c88f4763),volume_type_id=f6aa0296-0f51-4b49-b3e0-7b82c88f4763)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6401791e-7448-4929-b4c8-676e992cfe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6401791e-7448-4929-b4c8-676e992cfe0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c54059e-ad7c-43fc-8cb3-19bb1ac4dcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c54059e-ad7c-43fc-8cb3-19bb1ac4dcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f9ffdc-505d-4bd3-8d53-daac10eaf238', 'volume_name': 'volume-b2f9ffdc-505d-4bd3-8d53-daac10eaf238', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0af4cb-0ad2-4758-9fea-64b8140233a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0af4cb-0ad2-4758-9fea-64b8140233a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcf4e8d-e95d-42fa-bd7c-f95de4ca2217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:34 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Volume b2f9ffdc-505d-4bd3-8d53-daac10eaf238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f9ffdc-505d-4bd3-8d53-daac10eaf238', 'volume_size': 1} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:34 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d Jul 06 20:55:34 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:34 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2745e840-5631-4086-81e8-4059f53848f3 1073741824" returned: 0 in 1.103s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2745e840-5631-4086-81e8-4059f53848f3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:34 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2745e840-5631-4086-81e8-4059f53848f3 Jul 06 20:55:34 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:35 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d" returned: 0 in 0.844s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73936eb-6de1-4790-83b6-f1f34031d9a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d198fa70-1ce9-4cf8-bf2b-b06ddff34688]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:35 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 Jul 06 20:55:35 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:35 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2745e840-5631-4086-81e8-4059f53848f3" returned: 0 in 0.854s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.132s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-720023815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f9ffdc-505d-4bd3-8d53-daac10eaf238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b46095285546fb85fbbc4892e41204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:34Z,use_quota=True,user_id='53d92933936e4759a8ab13d7f8109239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6aa0296-0f51-4b49-b3e0-7b82c88f4763),volume_type_id=f6aa0296-0f51-4b49-b3e0-7b82c88f4763)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Creating volume b2f9ffdc-505d-4bd3-8d53-daac10eaf238 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:55:35 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b2f9ffdc-505d-4bd3-8d53-daac10eaf238 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b31c871-b153-4a80-922e-3e23469efca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2745e840-5631-4086-81e8-4059f53848f3', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:35 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b2f9ffdc-505d-4bd3-8d53-daac10eaf238 1073741824 Jul 06 20:55:35 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded2c861-868a-463a-b8f4-e95a0dfe45a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:35 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Volume volume-2745e840-5631-4086-81e8-4059f53848f3 (2745e840-5631-4086-81e8-4059f53848f3): created successfully Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded2c861-868a-463a-b8f4-e95a0dfe45a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Flow 'volume_create_manager' (672dee59-6c42-4ccd-bee8-70319af18db3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:55:35 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-fbe0fd22-720b-49b5-8f88-db2367b5fe9b tempest-ProjectReaderTests-254132344 None] Created volume successfully. Jul 06 20:55:36 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89" returned: 0 in 1.001s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:36 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73936eb-6de1-4790-83b6-f1f34031d9a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:55:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:36 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d Jul 06 20:55:36 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:36 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b2f9ffdc-505d-4bd3-8d53-daac10eaf238 1073741824" returned: 0 in 1.044s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] Acquiring lock "cinder-2745e840-5631-4086-81e8-4059f53848f3-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b2f9ffdc-505d-4bd3-8d53-daac10eaf238 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] Lock "cinder-2745e840-5631-4086-81e8-4059f53848f3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:36 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b2f9ffdc-505d-4bd3-8d53-daac10eaf238 Jul 06 20:55:36 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] Acquiring lock "cinder-quobyte-2745e840-5631-4086-81e8-4059f53848f3" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] Lock "cinder-quobyte-2745e840-5631-4086-81e8-4059f53848f3" acquired by "delete_volume" :: waited 0.027s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:36 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[345aab3e-d944-426a-96a0-3a5b580b5830]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2745e840-5631-4086-81e8-4059f53848f3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:36 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2745e840-5631-4086-81e8-4059f53848f3 Jul 06 20:55:36 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:37 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d" returned: 0 in 1.328s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:37 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d Jul 06 20:55:37 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:37 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b2f9ffdc-505d-4bd3-8d53-daac10eaf238" returned: 0 in 1.180s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:37 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] <== create_volume: return (2314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:55:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.323s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:37 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcf4e8d-e95d-42fa-bd7c-f95de4ca2217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f9ffdc-505d-4bd3-8d53-daac10eaf238', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:37 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aabcc7c-dde0-4bd8-b40d-0b85b94ebe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:37 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Volume volume-b2f9ffdc-505d-4bd3-8d53-daac10eaf238 (b2f9ffdc-505d-4bd3-8d53-daac10eaf238): created successfully Jul 06 20:55:37 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aabcc7c-dde0-4bd8-b40d-0b85b94ebe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:37 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Flow 'volume_create_manager' (c0987dd9-b6eb-49c2-b229-2ead7e6c3005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:55:37 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-94abb223-1039-4a75-aa30-004e9ff193bd tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Created volume successfully. Jul 06 20:55:37 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2745e840-5631-4086-81e8-4059f53848f3" returned: 0 in 1.129s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2745e840-5631-4086-81e8-4059f53848f3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:37 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2745e840-5631-4086-81e8-4059f53848f3 Jul 06 20:55:37 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:38 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.42716526-5304-4818-83e4-8820c3088a8d" returned: 0 in 0.809s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-quobyte-42716526-5304-4818-83e4-8820c3088a8d" released by "_delete_snapshot" :: held 4.180s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-quobyte-b73936eb-6de1-4790-83b6-f1f34031d9a7" released by "delete_snapshot" :: held 4.217s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:38 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] Created reservations ['43d59ca5-90d4-4301-8a32-f322a5d7a18e', '1ac15031-1469-421d-9d26-dd6dad571f58', '798e5c3b-5b96-4246-b1f6-69699cb7079b', '79fff9ec-377e-45a8-9a4c-b798cdd798a7'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:55:38 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] Delete snapshot completed successfully. Jul 06 20:55:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dc21be86-df2a-45d7-aa43-37923803d6d7 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-42716526-5304-4818-83e4-8820c3088a8d-delete_snapshot" released by "delete_snapshot" :: held 4.399s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:38 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2745e840-5631-4086-81e8-4059f53848f3" returned: 0 in 0.746s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] Lock "cinder-quobyte-2745e840-5631-4086-81e8-4059f53848f3" released by "delete_volume" :: held 1.947s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:38 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] Created reservations ['e4b5fccd-e0c3-4eee-9449-fe4482fa68d2', 'b32099f2-22e5-438f-9852-f16bb165b0e3', 'd176c7a3-4aa8-487f-868e-b11874d4ebb2', 'a1d780ce-f9a0-4064-8ed7-f8181367dfe1'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:55:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:55:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:55:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:38 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:55:38 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ea52f0bd-cc5d-4d69-aab1-270e7fa38769 tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ea52f0bd-cc5d-4d69-aab1-270e7fa38769 tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ea52f0bd-cc5d-4d69-aab1-270e7fa38769 tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:55:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ea52f0bd-cc5d-4d69-aab1-270e7fa38769 tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:55:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ea52f0bd-cc5d-4d69-aab1-270e7fa38769 tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ea52f0bd-cc5d-4d69-aab1-270e7fa38769 tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:39 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:55:39 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:39 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.903s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:39 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:55:39 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] Deleted volume successfully. Jul 06 20:55:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-39bfdd06-418d-4ab0-8905-1347363511c0 tempest-ProjectReaderTests-254132344 None] Lock "cinder-2745e840-5631-4086-81e8-4059f53848f3-delete_volume" released by "delete_volume" :: held 3.149s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-dfebed00-67fc-496d-af20-cde2a90988f2 tempest-SnapshotsActionsTest-793060599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-dfebed00-67fc-496d-af20-cde2a90988f2 tempest-SnapshotsActionsTest-793060599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-dfebed00-67fc-496d-af20-cde2a90988f2 tempest-SnapshotsActionsTest-793060599 None] Creating offline snapshot 30938a6f-e89b-46ff-a3f6-28e6330ed6da of volume b73936eb-6de1-4790-83b6-f1f34031d9a7 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:55:40 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6e8b57-19a7-491f-9f13-c3cd2e659048]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dfebed00-67fc-496d-af20-cde2a90988f2 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:40 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 Jul 06 20:55:40 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:40 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ea52f0bd-cc5d-4d69-aab1-270e7fa38769 tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.287s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:40 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-ea52f0bd-cc5d-4d69-aab1-270e7fa38769 tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:55:40 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-ea52f0bd-cc5d-4d69-aab1-270e7fa38769 tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Retype volume completed successfully. Jul 06 20:55:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Acquiring lock "cinder-b2f9ffdc-505d-4bd3-8d53-daac10eaf238-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Lock "cinder-b2f9ffdc-505d-4bd3-8d53-daac10eaf238-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Acquiring lock "cinder-quobyte-b2f9ffdc-505d-4bd3-8d53-daac10eaf238" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Lock "cinder-quobyte-b2f9ffdc-505d-4bd3-8d53-daac10eaf238" acquired by "delete_volume" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:40 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[066518d4-f5d2-44d5-8193-a7dbdd8cce34]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b2f9ffdc-505d-4bd3-8d53-daac10eaf238 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:41 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b2f9ffdc-505d-4bd3-8d53-daac10eaf238 Jul 06 20:55:41 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:41 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dfebed00-67fc-496d-af20-cde2a90988f2 tempest-SnapshotsActionsTest-793060599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89" returned: 0 in 1.344s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:41 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-dfebed00-67fc-496d-af20-cde2a90988f2 tempest-SnapshotsActionsTest-793060599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73936eb-6de1-4790-83b6-f1f34031d9a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:55:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dfebed00-67fc-496d-af20-cde2a90988f2 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:41 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da 1G Jul 06 20:55:41 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:41 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b2f9ffdc-505d-4bd3-8d53-daac10eaf238" returned: 0 in 1.062s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b2f9ffdc-505d-4bd3-8d53-daac10eaf238 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:41 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b2f9ffdc-505d-4bd3-8d53-daac10eaf238 Jul 06 20:55:42 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:42 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dfebed00-67fc-496d-af20-cde2a90988f2 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da 1G" returned: 0 in 1.106s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dfebed00-67fc-496d-af20-cde2a90988f2 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:42 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da Jul 06 20:55:42 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:42 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b2f9ffdc-505d-4bd3-8d53-daac10eaf238" returned: 0 in 0.903s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Lock "cinder-quobyte-b2f9ffdc-505d-4bd3-8d53-daac10eaf238" released by "delete_volume" :: held 2.019s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:42 devstack cinder-volume[87207]: WARNING cinder.quota [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:55:42 devstack cinder-volume[87207]: WARNING cinder.quota [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 06 20:55:42 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Created reservations ['ebfed0cb-ecf2-465b-8e93-fed369ff05a8', 'fc0ce2f5-ce27-4753-b79b-d6aae0b02894', '07cbc2ba-9e04-4982-b185-78b58f01dfa0', '91351948-065b-4ce7-b0da-117001c0c070'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:55:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:55:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:55:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:43 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:55:43 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:43 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dfebed00-67fc-496d-af20-cde2a90988f2 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da" returned: 0 in 0.897s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:43 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-dfebed00-67fc-496d-af20-cde2a90988f2 tempest-SnapshotsActionsTest-793060599 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da is being set with open permissions: ugo+rw Jul 06 20:55:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dfebed00-67fc-496d-af20-cde2a90988f2 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:43 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da Jul 06 20:55:43 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:43 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.783s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:43 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:55:43 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Deleted volume successfully. Jul 06 20:55:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e410dd02-9722-4905-853a-06290d29caef tempest-VolumeRetypeWithoutMigrationTest-1201030593 None] Lock "cinder-b2f9ffdc-505d-4bd3-8d53-daac10eaf238-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:44 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dfebed00-67fc-496d-af20-cde2a90988f2 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da" returned: 0 in 0.776s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:44 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=89,cinder:UPDATE=108,cinder:INSERT=24,cinder:DELETE=6 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:55:44 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:INSERT=32,cinder:SELECT=90,cinder:UPDATE=94,cinder:DELETE=7 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:55:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-dfebed00-67fc-496d-af20-cde2a90988f2 tempest-SnapshotsActionsTest-793060599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.258s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:44 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-dfebed00-67fc-496d-af20-cde2a90988f2 tempest-SnapshotsActionsTest-793060599 None] Create snapshot completed successfully Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Flow 'volume_create_manager' (3283767a-85c5-4c70-97cb-13b89e67ac52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a427e6-713b-4b9c-b1d7-f5ecbf94f366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a427e6-713b-4b9c-b1d7-f5ecbf94f366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-655422682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4298d662-fe19-40b5-876b-d74f727b7a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd6fbe0f081407e855950b70fe1619d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:45Z,use_quota=True,user_id='eb04c8ccd9594912b82a06d15c8164a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61ff853-033f-4987-b72f-54910e4eff6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61ff853-033f-4987-b72f-54910e4eff6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16629325-b265-4f5d-90d0-d90b7f82754c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16629325-b265-4f5d-90d0-d90b7f82754c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4298d662-fe19-40b5-876b-d74f727b7a53', 'volume_name': 'volume-4298d662-fe19-40b5-876b-d74f727b7a53', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafe907e-a3f9-412d-af95-1ba5d93fe741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafe907e-a3f9-412d-af95-1ba5d93fe741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ff1f6e-1bbb-4e01-af60-bfe68d865cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:45 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Volume 4298d662-fe19-40b5-876b-d74f727b7a53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4298d662-fe19-40b5-876b-d74f727b7a53', 'volume_size': 1} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-655422682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4298d662-fe19-40b5-876b-d74f727b7a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd6fbe0f081407e855950b70fe1619d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:45Z,use_quota=True,user_id='eb04c8ccd9594912b82a06d15c8164a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Creating volume 4298d662-fe19-40b5-876b-d74f727b7a53 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:55:45 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4298d662-fe19-40b5-876b-d74f727b7a53 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:45 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4298d662-fe19-40b5-876b-d74f727b7a53 1073741824 Jul 06 20:55:45 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] Acquiring lock "cinder-30938a6f-e89b-46ff-a3f6-28e6330ed6da-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-30938a6f-e89b-46ff-a3f6-28e6330ed6da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] Acquiring lock "cinder-quobyte-b73936eb-6de1-4790-83b6-f1f34031d9a7" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-quobyte-b73936eb-6de1-4790-83b6-f1f34031d9a7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] Acquiring lock "cinder-quobyte-30938a6f-e89b-46ff-a3f6-28e6330ed6da" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-quobyte-30938a6f-e89b-46ff-a3f6-28e6330ed6da" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] Deleting offline snapshot 30938a6f-e89b-46ff-a3f6-28e6330ed6da of volume b73936eb-6de1-4790-83b6-f1f34031d9a7 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] snapshot_file for this snap is: volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc2d006-49f6-4125-8067-a1ec6b637bb1]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:45 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da Jul 06 20:55:45 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:46 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4298d662-fe19-40b5-876b-d74f727b7a53 1073741824" returned: 0 in 1.194s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4298d662-fe19-40b5-876b-d74f727b7a53 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:46 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4298d662-fe19-40b5-876b-d74f727b7a53 Jul 06 20:55:46 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:46 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da" returned: 0 in 0.972s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73936eb-6de1-4790-83b6-f1f34031d9a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:55:46 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7110b0-5d72-44bf-912d-cabd7519e9e1]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:46 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 Jul 06 20:55:46 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:47 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4298d662-fe19-40b5-876b-d74f727b7a53" returned: 0 in 0.780s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:55:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ff1f6e-1bbb-4e01-af60-bfe68d865cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4298d662-fe19-40b5-876b-d74f727b7a53', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6189a65c-9b74-473f-bdc4-41264351e185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:47 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Volume volume-4298d662-fe19-40b5-876b-d74f727b7a53 (4298d662-fe19-40b5-876b-d74f727b7a53): created successfully Jul 06 20:55:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6189a65c-9b74-473f-bdc4-41264351e185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Flow 'volume_create_manager' (3283767a-85c5-4c70-97cb-13b89e67ac52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:55:47 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-5a6dfaab-2642-41a3-8e8b-8077f7344ff8 tempest-ProjectReaderTests-1156237136 None] Created volume successfully. Jul 06 20:55:47 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89" returned: 0 in 0.890s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73936eb-6de1-4790-83b6-f1f34031d9a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:55:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:47 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da Jul 06 20:55:47 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:48 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da" returned: 0 in 0.867s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:48 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da Jul 06 20:55:48 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] Acquiring lock "cinder-4298d662-fe19-40b5-876b-d74f727b7a53-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] Lock "cinder-4298d662-fe19-40b5-876b-d74f727b7a53-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] Acquiring lock "cinder-quobyte-4298d662-fe19-40b5-876b-d74f727b7a53" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] Lock "cinder-quobyte-4298d662-fe19-40b5-876b-d74f727b7a53" acquired by "delete_volume" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:48 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c394b1-301f-49f0-9e89-3b2b4ed16906]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4298d662-fe19-40b5-876b-d74f727b7a53 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:48 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4298d662-fe19-40b5-876b-d74f727b7a53 Jul 06 20:55:48 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:49 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.30938a6f-e89b-46ff-a3f6-28e6330ed6da" returned: 0 in 0.746s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-quobyte-30938a6f-e89b-46ff-a3f6-28e6330ed6da" released by "_delete_snapshot" :: held 3.627s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-quobyte-b73936eb-6de1-4790-83b6-f1f34031d9a7" released by "delete_snapshot" :: held 3.657s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:49 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] Created reservations ['72d00f15-f1c7-4e4f-881e-d20eb662a10f', '56044b00-01e2-4781-a85b-900b3b5c92be', '8e7e8d5e-a609-40da-9a37-99ed245f23f5', '5e696507-654e-494a-a75c-c41e1bb6da9c'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:55:49 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] Delete snapshot completed successfully. Jul 06 20:55:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-df230f91-5924-42a7-a7e1-971d4d400889 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-30938a6f-e89b-46ff-a3f6-28e6330ed6da-delete_snapshot" released by "delete_snapshot" :: held 3.844s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:49 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4298d662-fe19-40b5-876b-d74f727b7a53" returned: 0 in 0.934s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4298d662-fe19-40b5-876b-d74f727b7a53 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:49 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4298d662-fe19-40b5-876b-d74f727b7a53 Jul 06 20:55:49 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0c6acf2c-2392-46ed-9332-5a76d5c40566 tempest-SnapshotsActionsTest-793060599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0c6acf2c-2392-46ed-9332-5a76d5c40566 tempest-SnapshotsActionsTest-793060599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-0c6acf2c-2392-46ed-9332-5a76d5c40566 tempest-SnapshotsActionsTest-793060599 None] Creating offline snapshot d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795 of volume b73936eb-6de1-4790-83b6-f1f34031d9a7 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:55:50 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b7e184-2ac9-4416-a7a0-9efe8ce5ffce]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0c6acf2c-2392-46ed-9332-5a76d5c40566 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:50 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4298d662-fe19-40b5-876b-d74f727b7a53" returned: 0 in 0.917s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] Lock "cinder-quobyte-4298d662-fe19-40b5-876b-d74f727b7a53" released by "delete_volume" :: held 1.918s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:50 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] Created reservations ['df3d0d39-6f17-45b8-93bd-5c760af77d0e', '6ac9e6e2-3653-45e7-bdea-6eda94c44e88', 'f0967d64-42d4-4580-ba4a-649bf10e8367', 'f1cf531e-08ba-445c-98c2-270006c70d6e'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:55:50 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 Jul 06 20:55:50 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:55:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:55:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:50 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:55:50 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:51 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:55:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Flow 'volume_create_manager' (2e619789-e44d-434b-b274-f5e9a6b29166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:55:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8e127b-da97-4fbd-9478-47baaa5b7be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8e127b-da97-4fbd-9478-47baaa5b7be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1955041237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c80e71-3bb8-48bb-adb5-271ca4ece635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd6fbe0f081407e855950b70fe1619d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:52Z,use_quota=True,user_id='eb04c8ccd9594912b82a06d15c8164a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edea8714-ca51-4a13-bb94-847f595a657d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:52 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edea8714-ca51-4a13-bb94-847f595a657d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ac5337-e6e3-4b14-b67c-119dccf4904e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ac5337-e6e3-4b14-b67c-119dccf4904e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62c80e71-3bb8-48bb-adb5-271ca4ece635', 'volume_name': 'volume-62c80e71-3bb8-48bb-adb5-271ca4ece635', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dbaf278-2378-4610-8ee3-4477c0b1f0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dbaf278-2378-4610-8ee3-4477c0b1f0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389fd925-d847-4ec2-b545-a00dacfde685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:52 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Volume 62c80e71-3bb8-48bb-adb5-271ca4ece635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62c80e71-3bb8-48bb-adb5-271ca4ece635', 'volume_size': 1} Jul 06 20:55:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.141s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:52 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:55:52 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] Deleted volume successfully. Jul 06 20:55:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-695f887a-653e-49c4-a0d0-2b541fca11f5 tempest-ProjectReaderTests-1156237136 None] Lock "cinder-4298d662-fe19-40b5-876b-d74f727b7a53-delete_volume" released by "delete_volume" :: held 3.456s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:55:52 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0c6acf2c-2392-46ed-9332-5a76d5c40566 tempest-SnapshotsActionsTest-793060599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89" returned: 0 in 1.550s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-0c6acf2c-2392-46ed-9332-5a76d5c40566 tempest-SnapshotsActionsTest-793060599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73936eb-6de1-4790-83b6-f1f34031d9a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:55:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0c6acf2c-2392-46ed-9332-5a76d5c40566 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:52 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795 1G Jul 06 20:55:52 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:53 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0c6acf2c-2392-46ed-9332-5a76d5c40566 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795 1G" returned: 0 in 1.077s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0c6acf2c-2392-46ed-9332-5a76d5c40566 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:53 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795 Jul 06 20:55:53 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:54 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0c6acf2c-2392-46ed-9332-5a76d5c40566 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795" returned: 0 in 0.835s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:54 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-0c6acf2c-2392-46ed-9332-5a76d5c40566 tempest-SnapshotsActionsTest-793060599 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795 is being set with open permissions: ugo+rw Jul 06 20:55:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0c6acf2c-2392-46ed-9332-5a76d5c40566 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:54 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795 Jul 06 20:55:54 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:54 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0c6acf2c-2392-46ed-9332-5a76d5c40566 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795" returned: 0 in 0.682s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0c6acf2c-2392-46ed-9332-5a76d5c40566 tempest-SnapshotsActionsTest-793060599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.315s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.727s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1955041237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c80e71-3bb8-48bb-adb5-271ca4ece635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd6fbe0f081407e855950b70fe1619d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:52Z,use_quota=True,user_id='eb04c8ccd9594912b82a06d15c8164a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:55:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Creating volume 62c80e71-3bb8-48bb-adb5-271ca4ece635 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:55:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:55:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:55:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:55:54 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:55:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62c80e71-3bb8-48bb-adb5-271ca4ece635 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:54 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62c80e71-3bb8-48bb-adb5-271ca4ece635 1073741824 Jul 06 20:55:54 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:54 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0c6acf2c-2392-46ed-9332-5a76d5c40566 tempest-SnapshotsActionsTest-793060599 None] Create snapshot completed successfully Jul 06 20:55:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] Acquiring lock "cinder-d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] Acquiring lock "cinder-quobyte-b73936eb-6de1-4790-83b6-f1f34031d9a7" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-quobyte-b73936eb-6de1-4790-83b6-f1f34031d9a7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] Acquiring lock "cinder-quobyte-d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-quobyte-d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] Deleting offline snapshot d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795 of volume b73936eb-6de1-4790-83b6-f1f34031d9a7 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:55:55 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] snapshot_file for this snap is: volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:55:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62c80e71-3bb8-48bb-adb5-271ca4ece635 1073741824" returned: 0 in 1.072s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:55 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5b2007-2b4b-4421-8166-e9bf8a8ff340]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62c80e71-3bb8-48bb-adb5-271ca4ece635 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:55 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62c80e71-3bb8-48bb-adb5-271ca4ece635 Jul 06 20:55:55 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:56 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795 Jul 06 20:55:56 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:57 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62c80e71-3bb8-48bb-adb5-271ca4ece635" returned: 0 in 1.205s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] <== create_volume: return (2356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:55:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.359s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389fd925-d847-4ec2-b545-a00dacfde685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62c80e71-3bb8-48bb-adb5-271ca4ece635', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c444237b-679f-4cef-832e-0e2bce30a5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:55:57 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Volume volume-62c80e71-3bb8-48bb-adb5-271ca4ece635 (62c80e71-3bb8-48bb-adb5-271ca4ece635): created successfully Jul 06 20:55:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c444237b-679f-4cef-832e-0e2bce30a5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:55:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Flow 'volume_create_manager' (2e619789-e44d-434b-b274-f5e9a6b29166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:55:57 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d09b07cb-d7a4-4f4b-94b9-2a0f6cbca1e9 tempest-ProjectReaderTests-1156237136 None] Created volume successfully. Jul 06 20:55:57 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795" returned: 0 in 1.443s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73936eb-6de1-4790-83b6-f1f34031d9a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:55:57 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8dbb10-9daf-408d-907c-8cd069f90f3d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:57 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 Jul 06 20:55:57 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:57 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:55:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:55:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:55:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:55:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:55:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:55:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:58 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:55:58 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:58 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89" returned: 0 in 1.085s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73936eb-6de1-4790-83b6-f1f34031d9a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:55:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] Acquiring lock "cinder-62c80e71-3bb8-48bb-adb5-271ca4ece635-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:58 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795 Jul 06 20:55:58 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] Lock "cinder-62c80e71-3bb8-48bb-adb5-271ca4ece635-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] Acquiring lock "cinder-quobyte-62c80e71-3bb8-48bb-adb5-271ca4ece635" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:55:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] Lock "cinder-quobyte-62c80e71-3bb8-48bb-adb5-271ca4ece635" acquired by "delete_volume" :: waited 0.040s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:55:58 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ea3310-09c4-4c2f-bb10-d7f2f0a4801c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:55:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62c80e71-3bb8-48bb-adb5-271ca4ece635 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:58 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62c80e71-3bb8-48bb-adb5-271ca4ece635 Jul 06 20:55:58 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:59 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.053s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:59 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:55:59 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:55:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:55:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:55:59 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795" returned: 0 in 1.309s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:59 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795 Jul 06 20:55:59 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:55:59 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Jul 06 20:55:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62c80e71-3bb8-48bb-adb5-271ca4ece635" returned: 0 in 1.151s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:55:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62c80e71-3bb8-48bb-adb5-271ca4ece635 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:55:59 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62c80e71-3bb8-48bb-adb5-271ca4ece635 Jul 06 20:55:59 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:00 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795" returned: 0 in 1.049s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-quobyte-d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795" released by "_delete_snapshot" :: held 5.021s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-quobyte-b73936eb-6de1-4790-83b6-f1f34031d9a7" released by "delete_snapshot" :: held 5.050s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:01 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] Created reservations ['2c03be29-5cae-4a6e-810f-91e362490937', '7fa3d105-c41a-4ed8-93bd-a0ed772f083e', 'f45ec786-e00f-427e-918c-9e67d6240201', '53b0abbd-5868-4a61-bf88-2cd9a76b517f'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:56:01 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-62c80e71-3bb8-48bb-adb5-271ca4ece635" returned: 0 in 1.182s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:01 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] Lock "cinder-quobyte-62c80e71-3bb8-48bb-adb5-271ca4ece635" released by "delete_volume" :: held 2.428s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:01 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] Delete snapshot completed successfully. Jul 06 20:56:01 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d0747a4d-2f7b-40cb-870c-39f3a9cadd44 tempest-SnapshotsActionsTest-540795173 None] Lock "cinder-d5ecdf46-6c6d-43c4-bb0f-74fec0d9e795-delete_snapshot" released by "delete_snapshot" :: held 5.375s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:01 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] Created reservations ['c2d39a29-798a-4d56-9eff-d1b5eff9b6e7', '705003e7-92e4-498b-b81e-1128fe3a699a', '2b1cec1e-3b5c-4428-b45a-c82cf0cabfae', '4a152998-efe9-4f42-977e-d7fce3c23b76'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:56:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:56:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:56:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:01 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:56:01 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:02 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.934s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:56:02 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] Deleted volume successfully. Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0934b1aa-87cb-4b2a-9981-8350530f277f tempest-ProjectReaderTests-1156237136 None] Lock "cinder-62c80e71-3bb8-48bb-adb5-271ca4ece635-delete_volume" released by "delete_volume" :: held 3.731s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Flow 'volume_create_manager' (bcbcaf06-419d-4834-b86d-1a8ef0829cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae1663b-f59f-46aa-b65b-8105c8008969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae1663b-f59f-46aa-b65b-8105c8008969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-188976260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=543bf097-b65c-4709-bde8-00962dda6c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd6fbe0f081407e855950b70fe1619d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:03Z,use_quota=True,user_id='eb04c8ccd9594912b82a06d15c8164a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c8ff74-2ba6-466d-909a-0e6828086861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c8ff74-2ba6-466d-909a-0e6828086861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b9c47e-24e8-406d-9faa-96c1ba0256c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b9c47e-24e8-406d-9faa-96c1ba0256c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '543bf097-b65c-4709-bde8-00962dda6c15', 'volume_name': 'volume-543bf097-b65c-4709-bde8-00962dda6c15', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c95d73-900a-419e-a3ec-91d46a119f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c95d73-900a-419e-a3ec-91d46a119f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aed56ca-6b6b-4a59-a65b-efcaffa079b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:02 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Volume 543bf097-b65c-4709-bde8-00962dda6c15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-543bf097-b65c-4709-bde8-00962dda6c15', 'volume_size': 1} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-188976260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=543bf097-b65c-4709-bde8-00962dda6c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd6fbe0f081407e855950b70fe1619d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:03Z,use_quota=True,user_id='eb04c8ccd9594912b82a06d15c8164a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Creating volume 543bf097-b65c-4709-bde8-00962dda6c15 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:56:02 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:56:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-543bf097-b65c-4709-bde8-00962dda6c15 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:02 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-543bf097-b65c-4709-bde8-00962dda6c15 1073741824 Jul 06 20:56:02 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] Acquiring lock "cinder-1a16f67a-f031-4cb1-8e75-07736daf2f89-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] Lock "cinder-1a16f67a-f031-4cb1-8e75-07736daf2f89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] Acquiring lock "cinder-quobyte-b73936eb-6de1-4790-83b6-f1f34031d9a7" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] Lock "cinder-quobyte-b73936eb-6de1-4790-83b6-f1f34031d9a7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] Acquiring lock "cinder-quobyte-1a16f67a-f031-4cb1-8e75-07736daf2f89" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] Lock "cinder-quobyte-1a16f67a-f031-4cb1-8e75-07736daf2f89" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] Deleting offline snapshot 1a16f67a-f031-4cb1-8e75-07736daf2f89 of volume b73936eb-6de1-4790-83b6-f1f34031d9a7 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:56:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] snapshot_file for this snap is: volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:56:03 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15654fc-efd7-4665-a287-67fba8bf78b0]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:56:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:03 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 Jul 06 20:56:03 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:04 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-543bf097-b65c-4709-bde8-00962dda6c15 1073741824" returned: 0 in 1.685s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-543bf097-b65c-4709-bde8-00962dda6c15 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:04 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89" returned: 0 in 1.351s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73936eb-6de1-4790-83b6-f1f34031d9a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:56:04 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-543bf097-b65c-4709-bde8-00962dda6c15 Jul 06 20:56:04 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:04 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[407f0ae4-7993-49cd-be43-7a83c82f9df6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:56:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:04 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7 Jul 06 20:56:04 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:05 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-543bf097-b65c-4709-bde8-00962dda6c15" returned: 0 in 1.147s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] <== create_volume: return (2903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:56:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.907s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:05 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aed56ca-6b6b-4a59-a65b-efcaffa079b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-543bf097-b65c-4709-bde8-00962dda6c15', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:05 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae137a3-bd4b-4397-a5e4-0d36dd81e0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:05 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Volume volume-543bf097-b65c-4709-bde8-00962dda6c15 (543bf097-b65c-4709-bde8-00962dda6c15): created successfully Jul 06 20:56:05 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae137a3-bd4b-4397-a5e4-0d36dd81e0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:05 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Flow 'volume_create_manager' (bcbcaf06-419d-4834-b86d-1a8ef0829cd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:56:05 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-2e050f5c-443a-4855-85bb-6da48d5d1582 tempest-ProjectReaderTests-1156237136 None] Created volume successfully. Jul 06 20:56:05 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7" returned: 0 in 1.305s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:05 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 Jul 06 20:56:05 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:06 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89" returned: 0 in 1.063s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:07 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89 Jul 06 20:56:07 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] Acquiring lock "cinder-543bf097-b65c-4709-bde8-00962dda6c15-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] Lock "cinder-543bf097-b65c-4709-bde8-00962dda6c15-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] Acquiring lock "cinder-quobyte-543bf097-b65c-4709-bde8-00962dda6c15" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] Lock "cinder-quobyte-543bf097-b65c-4709-bde8-00962dda6c15" acquired by "delete_volume" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:07 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d359028f-371e-4413-b07d-8543a4c1d9cb]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:56:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-543bf097-b65c-4709-bde8-00962dda6c15 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:07 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-543bf097-b65c-4709-bde8-00962dda6c15 Jul 06 20:56:07 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:08 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7.1a16f67a-f031-4cb1-8e75-07736daf2f89" returned: 0 in 1.085s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] Lock "cinder-quobyte-1a16f67a-f031-4cb1-8e75-07736daf2f89" released by "_delete_snapshot" :: held 4.991s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] Lock "cinder-quobyte-b73936eb-6de1-4790-83b6-f1f34031d9a7" released by "delete_snapshot" :: held 5.040s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:08 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] Created reservations ['7a9f87f3-f47b-4ed4-988d-af61c4a31d80', 'fc35c819-332d-422b-8a66-b4311a667c2a', 'e7bf98c7-d2ae-443b-90d7-6c3222071160', 'b8d72085-8038-4e21-b944-0f8f843408f9'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:56:08 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] Delete snapshot completed successfully. Jul 06 20:56:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f97fad5f-4c08-403c-86be-b69ca2bf1c98 tempest-SnapshotsActionsTest-793060599 None] Lock "cinder-1a16f67a-f031-4cb1-8e75-07736daf2f89-delete_snapshot" released by "delete_snapshot" :: held 5.284s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] Acquiring lock "cinder-b73936eb-6de1-4790-83b6-f1f34031d9a7-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] Lock "cinder-b73936eb-6de1-4790-83b6-f1f34031d9a7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] Acquiring lock "cinder-quobyte-b73936eb-6de1-4790-83b6-f1f34031d9a7" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] Lock "cinder-quobyte-b73936eb-6de1-4790-83b6-f1f34031d9a7" acquired by "delete_volume" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:08 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fff8e7-6382-432f-8597-e64c0220f24a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:56:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:09 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7 Jul 06 20:56:09 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:09 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-543bf097-b65c-4709-bde8-00962dda6c15" returned: 0 in 1.783s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-543bf097-b65c-4709-bde8-00962dda6c15 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:09 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-543bf097-b65c-4709-bde8-00962dda6c15 Jul 06 20:56:09 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:10 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7" returned: 0 in 1.568s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:10 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7 Jul 06 20:56:10 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:10 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-543bf097-b65c-4709-bde8-00962dda6c15" returned: 0 in 1.232s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] Lock "cinder-quobyte-543bf097-b65c-4709-bde8-00962dda6c15" released by "delete_volume" :: held 3.078s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:10 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] Created reservations ['253c8a86-3d1c-48c0-939b-4361104c6ab2', '6723c5e3-cff9-4755-b940-fb135de7597c', '3bbaf961-908a-465f-9a4b-25b4b79665f0', '89db39dd-82dd-447e-b8f5-9d9b83ab70da'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:56:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:56:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:56:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:10 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:56:10 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:11 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b73936eb-6de1-4790-83b6-f1f34031d9a7" returned: 0 in 1.245s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] Lock "cinder-quobyte-b73936eb-6de1-4790-83b6-f1f34031d9a7" released by "delete_volume" :: held 2.927s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:11 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] Created reservations ['3a9dc830-b875-449b-94ea-36c203bfc0ee', '416fc673-adcd-42fb-9020-5e2a64cddcd1', '5b04a7d2-786d-4f30-b279-23378483b7d6', 'ba21f72a-9b04-4576-b9d8-7892a7f61053'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:56:11 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Flow 'volume_create_manager' (a74095e7-2854-413e-aefe-83da39d98d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83dcb73-4e8a-40f8-989e-803befdf23ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83dcb73-4e8a-40f8-989e-803befdf23ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-625491507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d39d6fd-cdef-4519-858b-f1f12a755176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd6fbe0f081407e855950b70fe1619d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:12Z,use_quota=True,user_id='eb04c8ccd9594912b82a06d15c8164a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e394569-039b-4a20-b74b-7c8cbdc7888d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e394569-039b-4a20-b74b-7c8cbdc7888d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b33c958-60f0-4d85-a1e2-add82c3ea4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b33c958-60f0-4d85-a1e2-add82c3ea4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d39d6fd-cdef-4519-858b-f1f12a755176', 'volume_name': 'volume-1d39d6fd-cdef-4519-858b-f1f12a755176', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bcc32a-ff5d-42e2-a984-d62afb5c1975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bcc32a-ff5d-42e2-a984-d62afb5c1975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91cd1cf-c96c-4064-8ca1-8e065ff95d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:12 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Volume 1d39d6fd-cdef-4519-858b-f1f12a755176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d39d6fd-cdef-4519-858b-f1f12a755176', 'volume_size': 1} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-625491507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d39d6fd-cdef-4519-858b-f1f12a755176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd6fbe0f081407e855950b70fe1619d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:12Z,use_quota=True,user_id='eb04c8ccd9594912b82a06d15c8164a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Creating volume 1d39d6fd-cdef-4519-858b-f1f12a755176 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:56:12 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1d39d6fd-cdef-4519-858b-f1f12a755176 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:12 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1d39d6fd-cdef-4519-858b-f1f12a755176 1073741824 Jul 06 20:56:12 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:12 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.443s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:12 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] Deleted volume successfully. Jul 06 20:56:12 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:56:12 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:12 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-46812e33-f388-458f-97e8-479a9e230f4c tempest-ProjectReaderTests-1156237136 None] Lock "cinder-543bf097-b65c-4709-bde8-00962dda6c15-delete_volume" released by "delete_volume" :: held 5.044s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:13 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.971s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:13 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:56:13 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] Deleted volume successfully. Jul 06 20:56:13 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-51a429eb-451a-4afd-aeea-9c96e02388a1 tempest-SnapshotsActionsTest-793060599 None] Lock "cinder-b73936eb-6de1-4790-83b6-f1f34031d9a7-delete_volume" released by "delete_volume" :: held 4.603s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:13 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1d39d6fd-cdef-4519-858b-f1f12a755176 1073741824" returned: 0 in 1.253s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1d39d6fd-cdef-4519-858b-f1f12a755176 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:13 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1d39d6fd-cdef-4519-858b-f1f12a755176 Jul 06 20:56:13 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:14 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1d39d6fd-cdef-4519-858b-f1f12a755176" returned: 0 in 0.694s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:56:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91cd1cf-c96c-4064-8ca1-8e065ff95d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d39d6fd-cdef-4519-858b-f1f12a755176', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e551a5-bd37-42cc-8c2f-95e109e35c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:14 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Volume volume-1d39d6fd-cdef-4519-858b-f1f12a755176 (1d39d6fd-cdef-4519-858b-f1f12a755176): created successfully Jul 06 20:56:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e551a5-bd37-42cc-8c2f-95e109e35c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Flow 'volume_create_manager' (a74095e7-2854-413e-aefe-83da39d98d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:56:14 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d817f9f8-c8b6-4dbf-901d-c52fd6e63243 tempest-ProjectReaderTests-1156237136 None] Created volume successfully. Jul 06 20:56:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] Acquiring lock "cinder-1d39d6fd-cdef-4519-858b-f1f12a755176-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] Lock "cinder-1d39d6fd-cdef-4519-858b-f1f12a755176-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] Acquiring lock "cinder-quobyte-1d39d6fd-cdef-4519-858b-f1f12a755176" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] Lock "cinder-quobyte-1d39d6fd-cdef-4519-858b-f1f12a755176" acquired by "delete_volume" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:15 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb7a74e-bfeb-4ac8-8636-94a5912225dd]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:56:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1d39d6fd-cdef-4519-858b-f1f12a755176 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:15 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1d39d6fd-cdef-4519-858b-f1f12a755176 Jul 06 20:56:15 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:16 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1d39d6fd-cdef-4519-858b-f1f12a755176" returned: 0 in 0.950s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1d39d6fd-cdef-4519-858b-f1f12a755176 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:16 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1d39d6fd-cdef-4519-858b-f1f12a755176 Jul 06 20:56:16 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:16 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-1d39d6fd-cdef-4519-858b-f1f12a755176" returned: 0 in 0.704s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:16 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] Lock "cinder-quobyte-1d39d6fd-cdef-4519-858b-f1f12a755176" released by "delete_volume" :: held 1.723s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:16 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] Created reservations ['caa4959e-c674-48db-b439-fc8348e2dbb1', '49a70db2-23a3-4202-a2b5-5f9ecdcecce7', '22fb152d-32ca-4649-a286-f7ba36ecab0f', '3d03e2a6-eed0-498d-8a23-22b9280dd70e'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:56:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:56:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:56:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:16 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:56:16 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:17 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.022s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:17 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:56:17 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] Deleted volume successfully. Jul 06 20:56:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c7864ac4-df1c-42e2-81a7-d9e26b01ddc8 tempest-ProjectReaderTests-1156237136 None] Lock "cinder-1d39d6fd-cdef-4519-858b-f1f12a755176-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Flow 'volume_create_manager' (29f199ef-eae6-45ae-9a63-c08d9f7dfb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2f156f-6671-4f92-8304-a28310031f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2f156f-6671-4f92-8304-a28310031f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1859984697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27e9c46ac4c4c9987831e60d6268a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:25Z,use_quota=True,user_id='7481e1102af34c1a83b171edcfd65b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba9a8ec-2e69-4477-ac50-0417e39a31bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba9a8ec-2e69-4477-ac50-0417e39a31bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98721ca-ec37-4dfb-b8e0-68b08fb781b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98721ca-ec37-4dfb-b8e0-68b08fb781b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e', 'volume_name': 'volume-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4730d07-648e-4079-874d-72c05da186f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4730d07-648e-4079-874d-72c05da186f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcaaa47f-7e55-4587-b3f0-dd3ecf9a556f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:25 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Volume 4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e', 'volume_size': 1} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1859984697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27e9c46ac4c4c9987831e60d6268a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:25Z,use_quota=True,user_id='7481e1102af34c1a83b171edcfd65b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Creating volume 4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:56:25 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:25 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e 1073741824 Jul 06 20:56:25 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Flow 'volume_create_manager' (88a9c8c0-2139-4175-b9a8-03bd1a4ba252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39282675-7f96-4a89-b5fd-1cc2a298c3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39282675-7f96-4a89-b5fd-1cc2a298c3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1652170049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705894d2-64a0-45c8-a5df-9bfb9ab00e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8baaad5e4136424c9b4330004fdab554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:26Z,use_quota=True,user_id='d5badb74e39e42449d0d06a48ffd8406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17149b3-d002-4515-b952-d502cd93bf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17149b3-d002-4515-b952-d502cd93bf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b783a619-6b17-4bf4-8dff-45d33dba498e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b783a619-6b17-4bf4-8dff-45d33dba498e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '705894d2-64a0-45c8-a5df-9bfb9ab00e30', 'volume_name': 'volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1df0b56-f26b-469f-b174-4899c3dc3dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1df0b56-f26b-469f-b174-4899c3dc3dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f31425-b1db-4e93-bdee-dfc96ef6c3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:25 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Volume 705894d2-64a0-45c8-a5df-9bfb9ab00e30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30', 'volume_size': 1} Jul 06 20:56:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:26 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e 1073741824" returned: 0 in 0.841s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:26 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e Jul 06 20:56:26 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:27 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e" returned: 0 in 0.667s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:27 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:56:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.285s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:27 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1652170049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705894d2-64a0-45c8-a5df-9bfb9ab00e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8baaad5e4136424c9b4330004fdab554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:26Z,use_quota=True,user_id='d5badb74e39e42449d0d06a48ffd8406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:56:27 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Creating volume 705894d2-64a0-45c8-a5df-9bfb9ab00e30 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:56:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:27 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:56:27 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:56:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:27 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:56:27 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:56:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:27 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30 1073741824 Jul 06 20:56:27 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcaaa47f-7e55-4587-b3f0-dd3ecf9a556f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d84fc13-4bb1-4a42-87e5-c5bfe9877c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:27 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Volume volume-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e (4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e): created successfully Jul 06 20:56:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d84fc13-4bb1-4a42-87e5-c5bfe9877c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:27 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Flow 'volume_create_manager' (29f199ef-eae6-45ae-9a63-c08d9f7dfb8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:56:27 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-668f70ec-5b25-4d2d-ab3a-459fc3a45539 tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Created volume successfully. Jul 06 20:56:28 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30 1073741824" returned: 0 in 0.929s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:28 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30 Jul 06 20:56:28 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:28 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Acquiring lock "cinder-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:28 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Lock "cinder-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:28 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Acquiring lock "cinder-quobyte-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:28 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Lock "cinder-quobyte-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e" acquired by "delete_volume" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:28 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[906d955f-599c-4bd1-96a6-1d18001c5277]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:56:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:28 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30" returned: 0 in 0.718s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:28 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:56:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:28 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f31425-b1db-4e93-bdee-dfc96ef6c3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:28 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5a4fac-1563-4c3d-b1c4-dfcd460d1356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:28 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Volume volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30 (705894d2-64a0-45c8-a5df-9bfb9ab00e30): created successfully Jul 06 20:56:28 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e Jul 06 20:56:28 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:28 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5a4fac-1563-4c3d-b1c4-dfcd460d1356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:28 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Flow 'volume_create_manager' (88a9c8c0-2139-4175-b9a8-03bd1a4ba252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:56:28 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-23c0929d-2786-4dde-b6f4-3e7b1fbcee1d tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Created volume successfully. Jul 06 20:56:29 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e" returned: 0 in 0.825s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:29 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e Jul 06 20:56:29 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:30 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e" returned: 0 in 0.823s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:30 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Lock "cinder-quobyte-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e" released by "delete_volume" :: held 1.703s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:30 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Created reservations ['04c388f0-6117-44d5-b712-371d741b2a4e', '3439c86d-b978-4a8b-9f32-640065afc476', 'ba87a042-bc2a-48de-adfa-26c13c916c7e', '75d65f23-8614-440c-8d1b-71082869a40a'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:56:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:56:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:56:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:30 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:56:30 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:31 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.839s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:31 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:56:31 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Deleted volume successfully. Jul 06 20:56:31 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-048dd5d0-04af-41d1-bbcd-86e25025f64a tempest-VolumeQuotasNegativeTestJSON-1231625081 None] Lock "cinder-4b1756dd-c4e6-4d12-9ce3-e83457fd6c3e-delete_volume" released by "delete_volume" :: held 2.803s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-53f114a6-1b16-4f40-a1fa-cfae8043d344 req-d9d8c49d-3279-49cc-bca5-4ac60bc8eade tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-53f114a6-1b16-4f40-a1fa-cfae8043d344 req-d9d8c49d-3279-49cc-bca5-4ac60bc8eade tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:33 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdd499b-4b01-4d64-b7ab-f89e8909462e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:56:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-53f114a6-1b16-4f40-a1fa-cfae8043d344 req-d9d8c49d-3279-49cc-bca5-4ac60bc8eade tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:33 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30 Jul 06 20:56:33 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:34 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-53f114a6-1b16-4f40-a1fa-cfae8043d344 req-d9d8c49d-3279-49cc-bca5-4ac60bc8eade tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30" returned: 0 in 0.828s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-53f114a6-1b16-4f40-a1fa-cfae8043d344 req-d9d8c49d-3279-49cc-bca5-4ac60bc8eade tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.856s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-53f114a6-1b16-4f40-a1fa-cfae8043d344 req-d9d8c49d-3279-49cc-bca5-4ac60bc8eade tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '916b130d-66d7-490f-ad22-96d1c5939e3d', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 20:56:34 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-53f114a6-1b16-4f40-a1fa-cfae8043d344 req-d9d8c49d-3279-49cc-bca5-4ac60bc8eade tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] attachment_update completed successfully. Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Flow 'volume_create_manager' (6b3fb924-e026-4530-9b8b-e587a53582c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d9b945-55d5-40e2-ae53-dc7e66bc4528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d9b945-55d5-40e2-ae53-dc7e66bc4528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-279003564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ecf1e4-1f03-4468-bc10-1ba61b8a4557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d13cb8cb3e9495a80f9cbf73357b22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:38Z,use_quota=True,user_id='f488dbeb7f594b2b908755adf0576e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe25d72d-b1bc-4339-940b-9a78875525f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe25d72d-b1bc-4339-940b-9a78875525f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d515507-1882-486b-827b-9ff8b9ceec45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d515507-1882-486b-827b-9ff8b9ceec45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4ecf1e4-1f03-4468-bc10-1ba61b8a4557', 'volume_name': 'volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7105f0f4-34a1-46f6-a877-41be2cc7af1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7105f0f4-34a1-46f6-a877-41be2cc7af1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13decf55-4eea-4799-8786-3b78f14a7e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:38 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Volume c4ecf1e4-1f03-4468-bc10-1ba61b8a4557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557', 'volume_size': 1} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-279003564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ecf1e4-1f03-4468-bc10-1ba61b8a4557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d13cb8cb3e9495a80f9cbf73357b22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:38Z,use_quota=True,user_id='f488dbeb7f594b2b908755adf0576e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Creating volume c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:56:38 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:56:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:38 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 1073741824 Jul 06 20:56:38 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:39 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 1073741824" returned: 0 in 0.877s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:39 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 Jul 06 20:56:39 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:40 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557" returned: 0 in 0.980s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13decf55-4eea-4799-8786-3b78f14a7e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbc9858-c003-43b8-a194-5ba661d179ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:40 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Volume volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 (c4ecf1e4-1f03-4468-bc10-1ba61b8a4557): created successfully Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbc9858-c003-43b8-a194-5ba661d179ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Flow 'volume_create_manager' (6b3fb924-e026-4530-9b8b-e587a53582c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Flow 'volume_create_manager' (dca86352-640f-4982-9619-0d5454a97c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54f8f11-4b77-49a3-843b-4c9756f5c5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:40 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-a2dc1690-02be-408e-9bf6-7fdf00d3c691 tempest-VolumesDeleteCascade-773702482 None] Created volume successfully. Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54f8f11-4b77-49a3-843b-4c9756f5c5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-974903097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8bd7ac3-965e-49a8-addd-90b4074e1a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d859ca0f0484696a44afe545f070da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:40Z,use_quota=True,user_id='f9e30844bf2f4488bde51e37664cab69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6573679b-9514-4098-8eab-9a195a169b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6573679b-9514-4098-8eab-9a195a169b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132993f1-e5ae-42d8-a168-7f1d47c6d24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132993f1-e5ae-42d8-a168-7f1d47c6d24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8bd7ac3-965e-49a8-addd-90b4074e1a65', 'volume_name': 'volume-e8bd7ac3-965e-49a8-addd-90b4074e1a65', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3594653b-0faf-4b0c-baa5-0104188b2bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3594653b-0faf-4b0c-baa5-0104188b2bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c7728a-9d32-4839-8fb1-5d8450f58a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:40 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Volume e8bd7ac3-965e-49a8-addd-90b4074e1a65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8bd7ac3-965e-49a8-addd-90b4074e1a65', 'volume_size': 1} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-974903097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8bd7ac3-965e-49a8-addd-90b4074e1a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d859ca0f0484696a44afe545f070da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:40Z,use_quota=True,user_id='f9e30844bf2f4488bde51e37664cab69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Creating volume e8bd7ac3-965e-49a8-addd-90b4074e1a65 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:56:40 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:56:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e8bd7ac3-965e-49a8-addd-90b4074e1a65 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:40 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e8bd7ac3-965e-49a8-addd-90b4074e1a65 1073741824 Jul 06 20:56:40 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:41 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e8bd7ac3-965e-49a8-addd-90b4074e1a65 1073741824" returned: 0 in 1.022s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e8bd7ac3-965e-49a8-addd-90b4074e1a65 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:41 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e8bd7ac3-965e-49a8-addd-90b4074e1a65 Jul 06 20:56:41 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:42 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-5477333a-170f-40d7-88be-d8cf4f39e782 req-e51b6993-5aae-4f86-9d77-6a673dace999 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Terminate volume connection completed successfully. Jul 06 20:56:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-5477333a-170f-40d7-88be-d8cf4f39e782 req-e51b6993-5aae-4f86-9d77-6a673dace999 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Deleting attachment 916b130d-66d7-490f-ad22-96d1c5939e3d. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 20:56:42 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e8bd7ac3-965e-49a8-addd-90b4074e1a65" returned: 0 in 0.726s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:56:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.739s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c7728a-9d32-4839-8fb1-5d8450f58a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8bd7ac3-965e-49a8-addd-90b4074e1a65', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480517e3-e240-4fc3-acc1-84096064706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] Creating offline snapshot 639de50e-fc91-42b4-b77c-4149ddb534d8 of volume c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:56:42 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Volume volume-e8bd7ac3-965e-49a8-addd-90b4074e1a65 (e8bd7ac3-965e-49a8-addd-90b4074e1a65): created successfully Jul 06 20:56:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480517e3-e240-4fc3-acc1-84096064706a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Flow 'volume_create_manager' (dca86352-640f-4982-9619-0d5454a97c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:56:42 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfee7cc-3630-4c64-b3ea-dd2b5ea8ff05]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:56:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:42 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-ad5248ed-16b0-47e2-b533-ab2f38e3df56 tempest-VolumesActionsTest-2024396447 None] Created volume successfully. Jul 06 20:56:42 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 Jul 06 20:56:42 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-39dc085d-7379-48f7-9cb9-3d85a7b51897 tempest-VolumesActionsTest-2024396447 None] Acquiring lock "cinder-e8bd7ac3-965e-49a8-addd-90b4074e1a65" by "attach_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-39dc085d-7379-48f7-9cb9-3d85a7b51897 tempest-VolumesActionsTest-2024396447 None] Lock "cinder-e8bd7ac3-965e-49a8-addd-90b4074e1a65" acquired by "attach_volume" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:42 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-39dc085d-7379-48f7-9cb9-3d85a7b51897 tempest-VolumesActionsTest-2024396447 None] Attaching volume e8bd7ac3-965e-49a8-addd-90b4074e1a65 to instance dcc81f41-c064-45f7-9a75-2716a67eb262 at mountpoint /dev/vdb on host None. Jul 06 20:56:42 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-39dc085d-7379-48f7-9cb9-3d85a7b51897 tempest-VolumesActionsTest-2024396447 None] Attach volume completed successfully. Jul 06 20:56:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-39dc085d-7379-48f7-9cb9-3d85a7b51897 tempest-VolumesActionsTest-2024396447 None] Lock "cinder-e8bd7ac3-965e-49a8-addd-90b4074e1a65" released by "attach_volume" :: held 0.101s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:43 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557" returned: 0 in 0.869s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:43 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 1G Jul 06 20:56:43 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:43 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-4496506b-25e9-4ef5-b459-a15033729f4f tempest-VolumesActionsTest-1783688265 None] Terminate volume connection completed successfully. Jul 06 20:56:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-4496506b-25e9-4ef5-b459-a15033729f4f tempest-VolumesActionsTest-1783688265 None] Acquiring lock "cinder-e8bd7ac3-965e-49a8-addd-90b4074e1a65-detach_volume" by "detach_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:44 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 1G" returned: 0 in 0.857s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-4496506b-25e9-4ef5-b459-a15033729f4f tempest-VolumesActionsTest-1783688265 None] Lock "cinder-e8bd7ac3-965e-49a8-addd-90b4074e1a65-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:44 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 Jul 06 20:56:44 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:44 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-4496506b-25e9-4ef5-b459-a15033729f4f tempest-VolumesActionsTest-1783688265 None] Detaching volume e8bd7ac3-965e-49a8-addd-90b4074e1a65 from instance dcc81f41-c064-45f7-9a75-2716a67eb262. Jul 06 20:56:44 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-4496506b-25e9-4ef5-b459-a15033729f4f tempest-VolumesActionsTest-1783688265 None] Detach volume completed successfully. Jul 06 20:56:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-4496506b-25e9-4ef5-b459-a15033729f4f tempest-VolumesActionsTest-1783688265 None] Lock "cinder-e8bd7ac3-965e-49a8-addd-90b4074e1a65-detach_volume" released by "detach_volume" :: held 0.096s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Acquiring lock "cinder-705894d2-64a0-45c8-a5df-9bfb9ab00e30-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Lock "cinder-705894d2-64a0-45c8-a5df-9bfb9ab00e30-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:44 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=78,cinder:UPDATE=95,cinder:DELETE=9,cinder:INSERT=26 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:56:44 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=80,cinder:UPDATE=96,cinder:INSERT=20,cinder:DELETE=7 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:56:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Acquiring lock "cinder-quobyte-705894d2-64a0-45c8-a5df-9bfb9ab00e30" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Lock "cinder-quobyte-705894d2-64a0-45c8-a5df-9bfb9ab00e30" acquired by "delete_volume" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:44 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dd35f3-ff3e-4d0d-b2b4-10d0b8e5f2d4]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:56:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:44 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30 Jul 06 20:56:44 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-17340593-b107-41cc-8135-9e6f01117db3 tempest-VolumesActionsTest-2024396447 None] Acquiring lock "cinder-e8bd7ac3-965e-49a8-addd-90b4074e1a65-detach_volume" by "detach_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-17340593-b107-41cc-8135-9e6f01117db3 tempest-VolumesActionsTest-2024396447 None] Lock "cinder-e8bd7ac3-965e-49a8-addd-90b4074e1a65-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:44 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-17340593-b107-41cc-8135-9e6f01117db3 tempest-VolumesActionsTest-2024396447 None] Volume detach called, but volume not attached. Jul 06 20:56:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-17340593-b107-41cc-8135-9e6f01117db3 tempest-VolumesActionsTest-2024396447 None] Lock "cinder-e8bd7ac3-965e-49a8-addd-90b4074e1a65-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:45 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8" returned: 0 in 0.841s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:45 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 is being set with open permissions: ugo+rw Jul 06 20:56:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:45 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 Jul 06 20:56:45 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:45 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30" returned: 0 in 0.838s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:45 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30 Jul 06 20:56:45 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] Acquiring lock "cinder-e8bd7ac3-965e-49a8-addd-90b4074e1a65-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] Lock "cinder-e8bd7ac3-965e-49a8-addd-90b4074e1a65-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] Acquiring lock "cinder-quobyte-e8bd7ac3-965e-49a8-addd-90b4074e1a65" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] Lock "cinder-quobyte-e8bd7ac3-965e-49a8-addd-90b4074e1a65" acquired by "delete_volume" :: waited 0.037s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:45 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e26512b-0f39-4c0b-88cd-e51f27fe668a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:56:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e8bd7ac3-965e-49a8-addd-90b4074e1a65 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:45 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8" returned: 0 in 0.772s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:45 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.info Jul 06 20:56:45 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:45 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e8bd7ac3-965e-49a8-addd-90b4074e1a65 Jul 06 20:56:45 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:46 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-705894d2-64a0-45c8-a5df-9bfb9ab00e30" returned: 0 in 0.852s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:46 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Lock "cinder-quobyte-705894d2-64a0-45c8-a5df-9bfb9ab00e30" released by "delete_volume" :: held 1.739s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:46 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Created reservations ['35c1388c-3c5b-46cc-9a23-663cc3818093', '3d68bd84-0b41-4522-ac88-a7a17d360367', '7ad5ebef-0b16-4abb-90e2-8f82ef2226b3', '60da23d3-bc15-49fd-9300-c787977f30c7'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:56:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:56:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:56:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:46 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:56:46 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:46 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.info" returned: 0 in 0.824s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:46 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.info is being set with open permissions: ugo+rw Jul 06 20:56:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:46 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.info Jul 06 20:56:46 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:46 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e8bd7ac3-965e-49a8-addd-90b4074e1a65" returned: 0 in 0.951s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e8bd7ac3-965e-49a8-addd-90b4074e1a65 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:46 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e8bd7ac3-965e-49a8-addd-90b4074e1a65 Jul 06 20:56:46 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:47 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e8bd7ac3-965e-49a8-addd-90b4074e1a65" returned: 0 in 0.826s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:47 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] Lock "cinder-quobyte-e8bd7ac3-965e-49a8-addd-90b4074e1a65" released by "delete_volume" :: held 1.831s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:47 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] Created reservations ['7b8d39ef-c841-492b-b4f4-5caed43093fe', 'cf010df5-7916-4ad3-bf87-cd4832eb6e9b', 'a13fe2c8-d4aa-4dd7-b4f1-c9c57e0669f1', '6b1a1834-f6fe-4c52-9e79-2505d576ba4b'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:56:47 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.116s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:47 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:56:47 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:47 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Deleted volume successfully. Jul 06 20:56:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.info" returned: 0 in 1.007s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.284s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:47 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0a352d2e-c082-499d-a745-a139f0bd5f07 tempest-TestServerVolumeAttachScenarioOldVersion-145880363 None] Lock "cinder-705894d2-64a0-45c8-a5df-9bfb9ab00e30-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:56:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:56:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:47 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-fb9a709d-20c7-4c30-9080-1edb1e642c47 tempest-VolumesDeleteCascade-773702482 None] Create snapshot completed successfully Jul 06 20:56:47 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:56:47 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0a383d66-7f16-4bd0-b777-16958192d89b tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0a383d66-7f16-4bd0-b777-16958192d89b tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:48 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.774s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:48 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:56:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-0a383d66-7f16-4bd0-b777-16958192d89b tempest-VolumesDeleteCascade-773702482 None] Creating offline snapshot a718e1ac-0427-4565-983d-610a8382bcac of volume c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:56:48 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] Deleted volume successfully. Jul 06 20:56:48 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5029f0-9e89-41b8-8a1e-770a6b7302b7]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:56:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a383d66-7f16-4bd0-b777-16958192d89b tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-02ad2a68-5908-462e-805d-9c87268d38ea tempest-VolumesActionsTest-2024396447 None] Lock "cinder-e8bd7ac3-965e-49a8-addd-90b4074e1a65-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:48 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 Jul 06 20:56:48 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:49 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a383d66-7f16-4bd0-b777-16958192d89b tempest-VolumesDeleteCascade-773702482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8" returned: 0 in 0.984s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-0a383d66-7f16-4bd0-b777-16958192d89b tempest-VolumesDeleteCascade-773702482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:56:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a383d66-7f16-4bd0-b777-16958192d89b tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:49 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac 1G Jul 06 20:56:49 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:50 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a383d66-7f16-4bd0-b777-16958192d89b tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac 1G" returned: 0 in 1.163s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a383d66-7f16-4bd0-b777-16958192d89b tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:50 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac Jul 06 20:56:50 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:51 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a383d66-7f16-4bd0-b777-16958192d89b tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac" returned: 0 in 0.752s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:51 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-0a383d66-7f16-4bd0-b777-16958192d89b tempest-VolumesDeleteCascade-773702482 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac is being set with open permissions: ugo+rw Jul 06 20:56:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a383d66-7f16-4bd0-b777-16958192d89b tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:51 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac Jul 06 20:56:51 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:52 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a383d66-7f16-4bd0-b777-16958192d89b tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac" returned: 0 in 0.622s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0a383d66-7f16-4bd0-b777-16958192d89b tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.665s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:52 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0a383d66-7f16-4bd0-b777-16958192d89b tempest-VolumesDeleteCascade-773702482 None] Create snapshot completed successfully Jul 06 20:56:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "cinder-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Performing cascade delete. {{(pid=87207) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 06 20:56:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "cinder-639de50e-fc91-42b4-b77c-4149ddb534d8-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-639de50e-fc91-42b4-b77c-4149ddb534d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "cinder-quobyte-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "cinder-quobyte-639de50e-fc91-42b4-b77c-4149ddb534d8" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-639de50e-fc91-42b4-b77c-4149ddb534d8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Deleting offline snapshot 639de50e-fc91-42b4-b77c-4149ddb534d8 of volume c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:56:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] snapshot_file for this snap is: volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:56:52 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b0036e-2c02-4a62-be93-19636355ad4e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:56:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:52 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 Jul 06 20:56:52 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:53 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8" returned: 0 in 0.769s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:56:53 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66c4fd5-4f38-4cfa-810b-06604c3fbd71]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:56:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:53 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 Jul 06 20:56:53 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:54 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557" returned: 0 in 0.741s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:54 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc27414-0986-47d3-a419-09d27186408e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:56:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:54 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac Jul 06 20:56:54 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:55 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac" returned: 0 in 0.767s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:56:55 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffbc668-9e00-4a71-a724-501c7d9454e3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:56:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:55 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 Jul 06 20:56:55 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:56 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8" returned: 0 in 0.835s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca55c58-e722-4397-b005-14fc43f10b3d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Flow 'volume_create_manager' (2201cf7c-5e06-4c5b-9803-d44e5fc6b5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ec35c3-d686-4550-80cf-8f4fac0c5fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:56 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 Jul 06 20:56:56 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ec35c3-d686-4550-80cf-8f4fac0c5fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1991455020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7b7c37-28fc-4bf3-8299-5614be4d377e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d859ca0f0484696a44afe545f070da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:56Z,use_quota=True,user_id='f9e30844bf2f4488bde51e37664cab69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2502246-e8d3-4ec4-a40a-9c72b8661a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2502246-e8d3-4ec4-a40a-9c72b8661a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25eca39d-2295-420a-8cee-79992463728e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25eca39d-2295-420a-8cee-79992463728e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e7b7c37-28fc-4bf3-8299-5614be4d377e', 'volume_name': 'volume-6e7b7c37-28fc-4bf3-8299-5614be4d377e', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c55e372b-0ec6-4506-b938-d2499ad178ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c55e372b-0ec6-4506-b938-d2499ad178ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e765ab2-0362-425f-ae9f-af8c7510f6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:56 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Volume 6e7b7c37-28fc-4bf3-8299-5614be4d377e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e7b7c37-28fc-4bf3-8299-5614be4d377e', 'volume_size': 1} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1991455020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7b7c37-28fc-4bf3-8299-5614be4d377e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d859ca0f0484696a44afe545f070da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:56Z,use_quota=True,user_id='f9e30844bf2f4488bde51e37664cab69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Creating volume 6e7b7c37-28fc-4bf3-8299-5614be4d377e {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:56:56 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6e7b7c37-28fc-4bf3-8299-5614be4d377e 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:56 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6e7b7c37-28fc-4bf3-8299-5614be4d377e 1073741824 Jul 06 20:56:56 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:56 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557" returned: 0 in 0.864s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:56 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 Jul 06 20:56:56 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:57 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6e7b7c37-28fc-4bf3-8299-5614be4d377e 1073741824" returned: 0 in 0.918s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6e7b7c37-28fc-4bf3-8299-5614be4d377e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:57 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6e7b7c37-28fc-4bf3-8299-5614be4d377e Jul 06 20:56:57 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:57 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8" returned: 0 in 0.793s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:57 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8 Jul 06 20:56:57 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:57 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6e7b7c37-28fc-4bf3-8299-5614be4d377e" returned: 0 in 0.718s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:56:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e765ab2-0362-425f-ae9f-af8c7510f6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e7b7c37-28fc-4bf3-8299-5614be4d377e', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e10204f-bc92-4af1-bc80-59edcb0abe3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:56:57 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Volume volume-6e7b7c37-28fc-4bf3-8299-5614be4d377e (6e7b7c37-28fc-4bf3-8299-5614be4d377e): created successfully Jul 06 20:56:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e10204f-bc92-4af1-bc80-59edcb0abe3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Flow 'volume_create_manager' (2201cf7c-5e06-4c5b-9803-d44e5fc6b5ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:58 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:56:58 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:58 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9ddbc587-4746-4b07-90bc-5dee140a9684 tempest-VolumesActionsTest-2024396447 None] Created volume successfully. Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] Acquiring lock "cinder-6e7b7c37-28fc-4bf3-8299-5614be4d377e-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:58 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.639de50e-fc91-42b4-b77c-4149ddb534d8" returned: 0 in 0.819s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac -F qcow2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] Lock "cinder-6e7b7c37-28fc-4bf3-8299-5614be4d377e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:58 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac -F qcow2 Jul 06 20:56:58 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] Acquiring lock "cinder-quobyte-6e7b7c37-28fc-4bf3-8299-5614be4d377e" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] Lock "cinder-quobyte-6e7b7c37-28fc-4bf3-8299-5614be4d377e" acquired by "delete_volume" :: waited 0.028s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a844fcc-69b7-4c13-a7eb-25445726b82f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6e7b7c37-28fc-4bf3-8299-5614be4d377e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:58 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.828s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:56:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:56:58 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6e7b7c37-28fc-4bf3-8299-5614be4d377e Jul 06 20:56:58 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:59 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac -F qcow2" returned: 0 in 0.874s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-639de50e-fc91-42b4-b77c-4149ddb534d8" released by "_delete_snapshot" :: held 6.632s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557" released by "delete_snapshot" :: held 6.656s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:59 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Created reservations ['42a56b30-bce5-4ca9-b471-5ba4850f1a38', '6655b9bd-2684-4015-bd12-f0a06bf60963', '91672a59-f7e9-4499-8399-befcea45417c', '4c730c10-4f9a-42d1-9756-fa84e93ad494'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:56:59 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Delete snapshot completed successfully. Jul 06 20:56:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-639de50e-fc91-42b4-b77c-4149ddb534d8-delete_snapshot" released by "delete_snapshot" :: held 6.850s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:56:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "cinder-a718e1ac-0427-4565-983d-610a8382bcac-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-a718e1ac-0427-4565-983d-610a8382bcac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "cinder-quobyte-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:59 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Jul 06 20:56:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6e7b7c37-28fc-4bf3-8299-5614be4d377e" returned: 0 in 0.959s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:56:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6e7b7c37-28fc-4bf3-8299-5614be4d377e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "cinder-quobyte-a718e1ac-0427-4565-983d-610a8382bcac" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:56:59 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6e7b7c37-28fc-4bf3-8299-5614be4d377e Jul 06 20:56:59 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:56:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-a718e1ac-0427-4565-983d-610a8382bcac" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:56:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Deleting offline snapshot a718e1ac-0427-4565-983d-610a8382bcac of volume c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:56:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] snapshot_file for this snap is: volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:56:59 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[027a078a-6415-46c9-8c87-a9ca210ab1bd]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:56:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:56:59 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac Jul 06 20:56:59 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:00 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6e7b7c37-28fc-4bf3-8299-5614be4d377e" returned: 0 in 0.722s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] Lock "cinder-quobyte-6e7b7c37-28fc-4bf3-8299-5614be4d377e" released by "delete_volume" :: held 1.764s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:00 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] Created reservations ['ad1b7c7d-1908-4f10-9130-88308ab1f6bb', '46db26d3-d468-43aa-84f6-d3d3e8d8b359', '3da29495-9b6c-417a-b0bc-92a36748a3b7', '01f3abd1-6a79-47aa-8037-4ef3538a0752'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:00 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:57:00 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:00 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac" returned: 0 in 0.959s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:57:00 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9131d735-3bd1-4e98-8938-530aa55a3adf]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:00 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 Jul 06 20:57:00 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:01 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.719s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:57:01 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] Deleted volume successfully. Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-baa3370e-100f-49f6-bfa6-5cb152f98421 tempest-VolumesActionsTest-1783688265 None] Lock "cinder-6e7b7c37-28fc-4bf3-8299-5614be4d377e-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Flow 'volume_create_manager' (3747f556-251d-4224-a699-b0b5cda2bf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe6bc3d-1743-4662-8fe0-2f738439596d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe6bc3d-1743-4662-8fe0-2f738439596d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1052736757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24168a77-c321-4e6c-b7d7-d123d4d83b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d859ca0f0484696a44afe545f070da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:01Z,use_quota=True,user_id='f9e30844bf2f4488bde51e37664cab69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9537d9e2-90dc-411e-ae4a-e9392f18d0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9537d9e2-90dc-411e-ae4a-e9392f18d0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a54962-7c06-4177-8993-b92bebf83cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a54962-7c06-4177-8993-b92bebf83cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24168a77-c321-4e6c-b7d7-d123d4d83b13', 'volume_name': 'volume-24168a77-c321-4e6c-b7d7-d123d4d83b13', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b729af1-7cda-49a7-b39b-69ec0263a54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b729af1-7cda-49a7-b39b-69ec0263a54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21b95ff-320d-419b-a83a-79ce61409b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:01 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Volume 24168a77-c321-4e6c-b7d7-d123d4d83b13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24168a77-c321-4e6c-b7d7-d123d4d83b13', 'volume_size': 1} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1052736757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24168a77-c321-4e6c-b7d7-d123d4d83b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d859ca0f0484696a44afe545f070da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:01Z,use_quota=True,user_id='f9e30844bf2f4488bde51e37664cab69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Creating volume 24168a77-c321-4e6c-b7d7-d123d4d83b13 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:01 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-24168a77-c321-4e6c-b7d7-d123d4d83b13 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:01 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-24168a77-c321-4e6c-b7d7-d123d4d83b13 1073741824 Jul 06 20:57:01 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:01 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557" returned: 0 in 1.101s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:01 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac Jul 06 20:57:01 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:02 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-24168a77-c321-4e6c-b7d7-d123d4d83b13 1073741824" returned: 0 in 0.943s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-24168a77-c321-4e6c-b7d7-d123d4d83b13 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:02 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-24168a77-c321-4e6c-b7d7-d123d4d83b13 Jul 06 20:57:02 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:02 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac" returned: 0 in 0.899s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:02 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac Jul 06 20:57:02 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:03 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-24168a77-c321-4e6c-b7d7-d123d4d83b13" returned: 0 in 0.853s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:57:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21b95ff-320d-419b-a83a-79ce61409b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24168a77-c321-4e6c-b7d7-d123d4d83b13', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a680bb2-accc-4438-a8db-8c50d4b09b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:03 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Volume volume-24168a77-c321-4e6c-b7d7-d123d4d83b13 (24168a77-c321-4e6c-b7d7-d123d4d83b13): created successfully Jul 06 20:57:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a680bb2-accc-4438-a8db-8c50d4b09b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Flow 'volume_create_manager' (3747f556-251d-4224-a699-b0b5cda2bf1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:03 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-6a3832a5-c9fc-4989-960e-9ec2a7172144 tempest-VolumesActionsTest-2024396447 None] Created volume successfully. Jul 06 20:57:03 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557.a718e1ac-0427-4565-983d-610a8382bcac" returned: 0 in 0.789s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-a718e1ac-0427-4565-983d-610a8382bcac" released by "_delete_snapshot" :: held 3.906s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557" released by "delete_snapshot" :: held 3.936s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:03 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Created reservations ['014a1d2d-3d8d-4fb5-a27f-4e6de22b99bf', '3624cf07-dac9-47f7-939c-d3419e9d898b', 'c6f8359a-55d8-4d83-bb43-75c9936d62ed', 'b969f220-3531-46f8-ab34-870bb9330bc7'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:03 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Delete snapshot completed successfully. Jul 06 20:57:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-a718e1ac-0427-4565-983d-610a8382bcac-delete_snapshot" released by "delete_snapshot" :: held 4.160s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Snapshots deleted, issuing volume delete {{(pid=87207) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 06 20:57:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "cinder-quobyte-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557" acquired by "delete_volume" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:03 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c8ffeb-41f3-43a0-b44f-7d76f41d879e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:03 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 Jul 06 20:57:03 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:04 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557" returned: 0 in 0.851s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:04 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557 Jul 06 20:57:04 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] Acquiring lock "cinder-24168a77-c321-4e6c-b7d7-d123d4d83b13-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] Lock "cinder-24168a77-c321-4e6c-b7d7-d123d4d83b13-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] Acquiring lock "cinder-quobyte-24168a77-c321-4e6c-b7d7-d123d4d83b13" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] Lock "cinder-quobyte-24168a77-c321-4e6c-b7d7-d123d4d83b13" acquired by "delete_volume" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:04 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[319f8003-4111-4680-8fd7-d23375fa1ee1]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-24168a77-c321-4e6c-b7d7-d123d4d83b13 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:05 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-24168a77-c321-4e6c-b7d7-d123d4d83b13 Jul 06 20:57:05 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:05 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557" returned: 0 in 0.760s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557" released by "delete_volume" :: held 1.673s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:05 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Created reservations ['2fc0cc33-0a28-43ce-92ac-50274f8cf4fa', '87fa6766-d4b8-44e5-8888-3c3f86e2c8d3', '64cffca6-4d7d-43c5-9498-c5f350060134', '2fa2502b-7825-47ad-b62b-35eb81d9e8a0'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:05 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:57:05 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:05 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-24168a77-c321-4e6c-b7d7-d123d4d83b13" returned: 0 in 0.844s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-24168a77-c321-4e6c-b7d7-d123d4d83b13 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:05 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-24168a77-c321-4e6c-b7d7-d123d4d83b13 Jul 06 20:57:05 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:06 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.872s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:57:06 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Deleted volume successfully. Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9d53f71a-6b14-45b5-a919-424ec90ad169 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-c4ecf1e4-1f03-4468-bc10-1ba61b8a4557-delete_volume" released by "delete_volume" :: held 13.873s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:06 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-24168a77-c321-4e6c-b7d7-d123d4d83b13" returned: 0 in 0.843s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Flow 'volume_create_manager' (2348ba4e-0f0f-4f96-8b43-3ba7c06cf691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270717fe-a1c0-4213-bf2d-f0ff98936749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] Lock "cinder-quobyte-24168a77-c321-4e6c-b7d7-d123d4d83b13" released by "delete_volume" :: held 1.757s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270717fe-a1c0-4213-bf2d-f0ff98936749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-104782134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ca64bc-20ea-4cf4-b951-832c82102f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d13cb8cb3e9495a80f9cbf73357b22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:07Z,use_quota=True,user_id='f488dbeb7f594b2b908755adf0576e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467d0c32-9e98-4a6e-838f-1c7c729cc049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467d0c32-9e98-4a6e-838f-1c7c729cc049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d189f535-993f-4565-ba94-6d4638f92a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d189f535-993f-4565-ba94-6d4638f92a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68ca64bc-20ea-4cf4-b951-832c82102f61', 'volume_name': 'volume-68ca64bc-20ea-4cf4-b951-832c82102f61', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803a879f-0e77-4a14-9227-2e341f27b8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803a879f-0e77-4a14-9227-2e341f27b8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eee4059-c2fd-4811-b78e-4c2abc2ea9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:06 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Volume 68ca64bc-20ea-4cf4-b951-832c82102f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68ca64bc-20ea-4cf4-b951-832c82102f61', 'volume_size': 1} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-104782134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ca64bc-20ea-4cf4-b951-832c82102f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d13cb8cb3e9495a80f9cbf73357b22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:07Z,use_quota=True,user_id='f488dbeb7f594b2b908755adf0576e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Creating volume 68ca64bc-20ea-4cf4-b951-832c82102f61 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:06 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:06 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 1073741824 Jul 06 20:57:06 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] Created reservations ['efe2c5d6-cb47-4aed-8510-8057c8adf8ea', '7c46c18f-0293-4405-bf71-c3a38bf430bc', 'f2a8fe20-6a2e-403c-9b46-d91694d7a71f', '8a8a7472-046a-40cc-8f79-9b775f86c580'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:06 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:57:06 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:07 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.947s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:07 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:57:07 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 1073741824" returned: 0 in 1.092s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:07 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] Deleted volume successfully. Jul 06 20:57:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-55de425b-d38b-4696-b617-fe340a114083 tempest-VolumesActionsTest-1783688265 None] Lock "cinder-24168a77-c321-4e6c-b7d7-d123d4d83b13-delete_volume" released by "delete_volume" :: held 3.010s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:07 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 Jul 06 20:57:07 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Flow 'volume_create_manager' (2c906fc1-88a9-4e86-aab7-fc92416d892b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b627254-7a2e-4497-a8fd-3174a6e6078e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b627254-7a2e-4497-a8fd-3174a6e6078e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-758153300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768ef377-94f6-4399-ad91-06040a5da5dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8566d1366b0d485ea303dd2d920615db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:08Z,use_quota=True,user_id='41a7afb1b1ad4e2d92e56bacb452037f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99db72ca-ef3e-4b15-b447-8349c825e586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99db72ca-ef3e-4b15-b447-8349c825e586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a2df3e-6b70-4acd-8432-b6127a2850a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a2df3e-6b70-4acd-8432-b6127a2850a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '768ef377-94f6-4399-ad91-06040a5da5dd', 'volume_name': 'volume-768ef377-94f6-4399-ad91-06040a5da5dd', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda979b7-149d-439a-ad81-0ea62dfab337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda979b7-149d-439a-ad81-0ea62dfab337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1fc643-bf7e-4e91-85cb-27c89ef85723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Volume 768ef377-94f6-4399-ad91-06040a5da5dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-768ef377-94f6-4399-ad91-06040a5da5dd', 'volume_size': 1} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Flow 'volume_create_manager' (471d8655-3f24-4a50-b915-34c467f6624c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a4b374-5163-4154-a709-b4ef780afced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Flow 'volume_create_manager' (7d3d290a-2a9b-4b53-910c-7ee882d2bf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9038e5c0-c4a7-42da-ac9e-0c2f5d455840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a4b374-5163-4154-a709-b4ef780afced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1642261984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b44b652-4ce3-4cbb-be17-83b94d336ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8566d1366b0d485ea303dd2d920615db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:08Z,use_quota=True,user_id='41a7afb1b1ad4e2d92e56bacb452037f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4a301d-15fe-4b37-96c4-026785aa57db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4a301d-15fe-4b37-96c4-026785aa57db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d5a4d6-01ec-4ed7-968f-bcbe241c7373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d5a4d6-01ec-4ed7-968f-bcbe241c7373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b44b652-4ce3-4cbb-be17-83b94d336ce9', 'volume_name': 'volume-3b44b652-4ce3-4cbb-be17-83b94d336ce9', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08679cb-c21b-4901-a9ef-1ef7830e63d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08679cb-c21b-4901-a9ef-1ef7830e63d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528a88a1-a547-45c9-b77b-2fdb19c397ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Volume 3b44b652-4ce3-4cbb-be17-83b94d336ce9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b44b652-4ce3-4cbb-be17-83b94d336ce9', 'volume_size': 1} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9038e5c0-c4a7-42da-ac9e-0c2f5d455840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1897017951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=606ba92e-3b52-49bc-b6d9-35690882d12e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d859ca0f0484696a44afe545f070da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:08Z,use_quota=True,user_id='f9e30844bf2f4488bde51e37664cab69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b58053-495b-4416-b2a2-b165a4b1514e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b58053-495b-4416-b2a2-b165a4b1514e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3176492-1b4d-4b7b-a1b9-4c75dba88f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3176492-1b4d-4b7b-a1b9-4c75dba88f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '606ba92e-3b52-49bc-b6d9-35690882d12e', 'volume_name': 'volume-606ba92e-3b52-49bc-b6d9-35690882d12e', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb785128-c098-4123-ab3c-f6b34bb616c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb785128-c098-4123-ab3c-f6b34bb616c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e73d8c7-051c-4c8b-b494-09f6627c5130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Volume 606ba92e-3b52-49bc-b6d9-35690882d12e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-606ba92e-3b52-49bc-b6d9-35690882d12e', 'volume_size': 1} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Flow 'volume_create_manager' (fa628135-28a5-4110-a0e2-d2be16ec51f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:08 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afad7d6a-33c4-4272-a5ee-6ba45f9afb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61" returned: 0 in 0.780s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.355s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-758153300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768ef377-94f6-4399-ad91-06040a5da5dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8566d1366b0d485ea303dd2d920615db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:08Z,use_quota=True,user_id='41a7afb1b1ad4e2d92e56bacb452037f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Creating volume 768ef377-94f6-4399-ad91-06040a5da5dd {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:08 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-768ef377-94f6-4399-ad91-06040a5da5dd 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:08 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-768ef377-94f6-4399-ad91-06040a5da5dd 1073741824 Jul 06 20:57:08 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afad7d6a-33c4-4272-a5ee-6ba45f9afb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1453378669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87981e1a-c9f7-4884-bdb6-ad02863f8415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8566d1366b0d485ea303dd2d920615db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:08Z,use_quota=True,user_id='41a7afb1b1ad4e2d92e56bacb452037f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c613f5e-48a9-4075-acb2-9442f3ee2317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c613f5e-48a9-4075-acb2-9442f3ee2317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6818e1-9df6-4006-8696-ef22b209b1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6818e1-9df6-4006-8696-ef22b209b1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87981e1a-c9f7-4884-bdb6-ad02863f8415', 'volume_name': 'volume-87981e1a-c9f7-4884-bdb6-ad02863f8415', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2394e666-ad75-4e2c-a32c-ad47d204d60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2394e666-ad75-4e2c-a32c-ad47d204d60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3172c8fc-24f9-4bb3-b3d3-716ae96f8f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Volume 87981e1a-c9f7-4884-bdb6-ad02863f8415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87981e1a-c9f7-4884-bdb6-ad02863f8415', 'volume_size': 1} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eee4059-c2fd-4811-b78e-4c2abc2ea9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68ca64bc-20ea-4cf4-b951-832c82102f61', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120bd1e9-7a6b-4005-b26d-e52c00a0d3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Volume volume-68ca64bc-20ea-4cf4-b951-832c82102f61 (68ca64bc-20ea-4cf4-b951-832c82102f61): created successfully Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120bd1e9-7a6b-4005-b26d-e52c00a0d3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Flow 'volume_create_manager' (2348ba4e-0f0f-4f96-8b43-3ba7c06cf691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Flow 'volume_create_manager' (612e101b-ed5a-4d4b-8d28-e7e9c7b4dc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25669a4f-46bc-4e08-839b-294cb880f5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9fe22fda-6ef6-4f5a-a3bd-896c0d47a465 tempest-VolumesDeleteCascade-773702482 None] Created volume successfully. Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25669a4f-46bc-4e08-839b-294cb880f5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-226275171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63f5cfc-a025-4c6d-aec5-34babd3c1416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8566d1366b0d485ea303dd2d920615db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:09Z,use_quota=True,user_id='41a7afb1b1ad4e2d92e56bacb452037f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4542fb-0de3-4a27-9d5b-2935a2cb87dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4542fb-0de3-4a27-9d5b-2935a2cb87dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f973c5cc-bb0b-44eb-8661-291d28c11e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f973c5cc-bb0b-44eb-8661-291d28c11e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b63f5cfc-a025-4c6d-aec5-34babd3c1416', 'volume_name': 'volume-b63f5cfc-a025-4c6d-aec5-34babd3c1416', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759a728e-a29b-43c2-bc48-16e89bffaca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759a728e-a29b-43c2-bc48-16e89bffaca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9de8d35-c6ae-4765-9ab5-dd2839332b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:08 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Volume b63f5cfc-a025-4c6d-aec5-34babd3c1416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b63f5cfc-a025-4c6d-aec5-34babd3c1416', 'volume_size': 1} Jul 06 20:57:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:09 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Flow 'volume_create_manager' (6c607f3e-c4a5-4bf4-9352-5352839c0179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbf969a-dbfd-426f-b1de-42aad5b92d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbf969a-dbfd-426f-b1de-42aad5b92d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1493314226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc13b475-0006-4b7a-9e34-234c35e41401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8566d1366b0d485ea303dd2d920615db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:09Z,use_quota=True,user_id='41a7afb1b1ad4e2d92e56bacb452037f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15e0e14-dbe1-406c-b21c-7cc98d1fb5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15e0e14-dbe1-406c-b21c-7cc98d1fb5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b0ce68-fa24-4871-a682-1d5462786bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b0ce68-fa24-4871-a682-1d5462786bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc13b475-0006-4b7a-9e34-234c35e41401', 'volume_name': 'volume-dc13b475-0006-4b7a-9e34-234c35e41401', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf463bf-d8eb-493d-b97c-6968d3b380bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf463bf-d8eb-493d-b97c-6968d3b380bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581fd83c-7b68-46e3-abfc-a5b82d2c5064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:09 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Volume dc13b475-0006-4b7a-9e34-234c35e41401: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc13b475-0006-4b7a-9e34-234c35e41401', 'volume_size': 1} Jul 06 20:57:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:09 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-768ef377-94f6-4399-ad91-06040a5da5dd 1073741824" returned: 0 in 0.797s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-768ef377-94f6-4399-ad91-06040a5da5dd {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:09 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-768ef377-94f6-4399-ad91-06040a5da5dd Jul 06 20:57:09 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:10 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-768ef377-94f6-4399-ad91-06040a5da5dd" returned: 0 in 0.629s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.657s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1642261984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b44b652-4ce3-4cbb-be17-83b94d336ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8566d1366b0d485ea303dd2d920615db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:08Z,use_quota=True,user_id='41a7afb1b1ad4e2d92e56bacb452037f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Creating volume 3b44b652-4ce3-4cbb-be17-83b94d336ce9 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:10 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3b44b652-4ce3-4cbb-be17-83b94d336ce9 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:10 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3b44b652-4ce3-4cbb-be17-83b94d336ce9 1073741824 Jul 06 20:57:10 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1fc643-bf7e-4e91-85cb-27c89ef85723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-768ef377-94f6-4399-ad91-06040a5da5dd', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f600a6b-6af2-4869-af5d-dbee4a162e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:10 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Volume volume-768ef377-94f6-4399-ad91-06040a5da5dd (768ef377-94f6-4399-ad91-06040a5da5dd): created successfully Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f600a6b-6af2-4869-af5d-dbee4a162e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Flow 'volume_create_manager' (2c906fc1-88a9-4e86-aab7-fc92416d892b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:10 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d440a608-6b6c-408e-9e94-de1a19ccc887 tempest-CreateVolumesFromImageTest-893908324 None] Created volume successfully. Jul 06 20:57:10 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3b44b652-4ce3-4cbb-be17-83b94d336ce9 1073741824" returned: 0 in 0.789s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3b44b652-4ce3-4cbb-be17-83b94d336ce9 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:10 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3b44b652-4ce3-4cbb-be17-83b94d336ce9 Jul 06 20:57:10 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:11 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:11 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-606ba92e-3b52-49bc-b6d9-35690882d12e 1073741824 Jul 06 20:57:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3b44b652-4ce3-4cbb-be17-83b94d336ce9" returned: 0 in 0.629s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:57:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.055s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1897017951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=606ba92e-3b52-49bc-b6d9-35690882d12e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d859ca0f0484696a44afe545f070da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:08Z,use_quota=True,user_id='f9e30844bf2f4488bde51e37664cab69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:57:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Creating volume 606ba92e-3b52-49bc-b6d9-35690882d12e {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:57:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:11 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:11 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:57:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-606ba92e-3b52-49bc-b6d9-35690882d12e 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528a88a1-a547-45c9-b77b-2fdb19c397ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b44b652-4ce3-4cbb-be17-83b94d336ce9', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263a3a8b-1177-4c64-ac21-419bc29b2c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:11 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Volume volume-3b44b652-4ce3-4cbb-be17-83b94d336ce9 (3b44b652-4ce3-4cbb-be17-83b94d336ce9): created successfully Jul 06 20:57:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263a3a8b-1177-4c64-ac21-419bc29b2c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Flow 'volume_create_manager' (471d8655-3f24-4a50-b915-34c467f6624c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:11 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-4c3d5bc2-b85c-42a9-be60-d42c38863b97 tempest-CreateVolumesFromImageTest-893908324 None] Created volume successfully. Jul 06 20:57:12 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-606ba92e-3b52-49bc-b6d9-35690882d12e 1073741824" returned: 0 in 0.839s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-606ba92e-3b52-49bc-b6d9-35690882d12e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:12 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-606ba92e-3b52-49bc-b6d9-35690882d12e Jul 06 20:57:12 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:13 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-606ba92e-3b52-49bc-b6d9-35690882d12e" returned: 0 in 0.618s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.356s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1453378669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87981e1a-c9f7-4884-bdb6-ad02863f8415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8566d1366b0d485ea303dd2d920615db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:08Z,use_quota=True,user_id='41a7afb1b1ad4e2d92e56bacb452037f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Creating volume 87981e1a-c9f7-4884-bdb6-ad02863f8415 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:13 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87981e1a-c9f7-4884-bdb6-ad02863f8415 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:13 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87981e1a-c9f7-4884-bdb6-ad02863f8415 1073741824 Jul 06 20:57:13 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e73d8c7-051c-4c8b-b494-09f6627c5130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-606ba92e-3b52-49bc-b6d9-35690882d12e', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478c6d79-6677-4e30-b6a0-83e7994eb26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:13 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Volume volume-606ba92e-3b52-49bc-b6d9-35690882d12e (606ba92e-3b52-49bc-b6d9-35690882d12e): created successfully Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478c6d79-6677-4e30-b6a0-83e7994eb26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Flow 'volume_create_manager' (7d3d290a-2a9b-4b53-910c-7ee882d2bf37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:13 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-5d7d27c7-bb74-4b91-a708-9e83c27ed7ec tempest-VolumesActionsTest-2024396447 None] Created volume successfully. Jul 06 20:57:13 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87981e1a-c9f7-4884-bdb6-ad02863f8415 1073741824" returned: 0 in 0.767s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87981e1a-c9f7-4884-bdb6-ad02863f8415 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:13 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87981e1a-c9f7-4884-bdb6-ad02863f8415 Jul 06 20:57:13 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] Acquiring lock "cinder-606ba92e-3b52-49bc-b6d9-35690882d12e-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] Lock "cinder-606ba92e-3b52-49bc-b6d9-35690882d12e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] Acquiring lock "cinder-quobyte-606ba92e-3b52-49bc-b6d9-35690882d12e" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] Lock "cinder-quobyte-606ba92e-3b52-49bc-b6d9-35690882d12e" acquired by "delete_volume" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[925d3e45-2a8f-48ea-ab74-08f35b672a88]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-606ba92e-3b52-49bc-b6d9-35690882d12e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:14 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87981e1a-c9f7-4884-bdb6-ad02863f8415" returned: 0 in 0.639s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.667s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-226275171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63f5cfc-a025-4c6d-aec5-34babd3c1416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8566d1366b0d485ea303dd2d920615db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:09Z,use_quota=True,user_id='41a7afb1b1ad4e2d92e56bacb452037f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Creating volume b63f5cfc-a025-4c6d-aec5-34babd3c1416 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:14 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b63f5cfc-a025-4c6d-aec5-34babd3c1416 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:14 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-606ba92e-3b52-49bc-b6d9-35690882d12e Jul 06 20:57:14 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3172c8fc-24f9-4bb3-b3d3-716ae96f8f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87981e1a-c9f7-4884-bdb6-ad02863f8415', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:14 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b63f5cfc-a025-4c6d-aec5-34babd3c1416 1073741824 Jul 06 20:57:14 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76e4d59-0b7d-4065-a9bc-54acc8d8e879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:14 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Volume volume-87981e1a-c9f7-4884-bdb6-ad02863f8415 (87981e1a-c9f7-4884-bdb6-ad02863f8415): created successfully Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76e4d59-0b7d-4065-a9bc-54acc8d8e879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Flow 'volume_create_manager' (fa628135-28a5-4110-a0e2-d2be16ec51f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:14 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-36a6d2a9-1864-42ce-891c-871ca3bedafb tempest-CreateVolumesFromImageTest-893908324 None] Created volume successfully. Jul 06 20:57:15 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-606ba92e-3b52-49bc-b6d9-35690882d12e" returned: 0 in 0.771s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-606ba92e-3b52-49bc-b6d9-35690882d12e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:15 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-606ba92e-3b52-49bc-b6d9-35690882d12e Jul 06 20:57:15 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:15 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b63f5cfc-a025-4c6d-aec5-34babd3c1416 1073741824" returned: 0 in 0.812s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b63f5cfc-a025-4c6d-aec5-34babd3c1416 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:15 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b63f5cfc-a025-4c6d-aec5-34babd3c1416 Jul 06 20:57:15 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:15 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-606ba92e-3b52-49bc-b6d9-35690882d12e" returned: 0 in 0.623s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] Lock "cinder-quobyte-606ba92e-3b52-49bc-b6d9-35690882d12e" released by "delete_volume" :: held 1.438s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:15 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] Created reservations ['979ff616-e493-42ec-bb33-0ef47c78998f', '20fac711-f154-4992-acd9-825e61e35b41', 'be09e45b-5c16-4518-8908-c68527200118', 'd9a956e5-a71a-4704-b84d-ab2b22a33acc'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:16 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b63f5cfc-a025-4c6d-aec5-34babd3c1416" returned: 0 in 0.625s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:16 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:57:16 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.915s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1493314226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc13b475-0006-4b7a-9e34-234c35e41401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8566d1366b0d485ea303dd2d920615db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:09Z,use_quota=True,user_id='41a7afb1b1ad4e2d92e56bacb452037f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Creating volume dc13b475-0006-4b7a-9e34-234c35e41401 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:16 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc13b475-0006-4b7a-9e34-234c35e41401 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:16 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc13b475-0006-4b7a-9e34-234c35e41401 1073741824 Jul 06 20:57:16 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9de8d35-c6ae-4765-9ab5-dd2839332b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63f5cfc-a025-4c6d-aec5-34babd3c1416', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3dc347-c6b5-4f48-a1d8-544d1ba9ecc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:16 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Volume volume-b63f5cfc-a025-4c6d-aec5-34babd3c1416 (b63f5cfc-a025-4c6d-aec5-34babd3c1416): created successfully Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3dc347-c6b5-4f48-a1d8-544d1ba9ecc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Flow 'volume_create_manager' (612e101b-ed5a-4d4b-8d28-e7e9c7b4dc9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:16 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-70f1ebf1-56ea-49a0-8a61-4f965be92d93 tempest-CreateVolumesFromImageTest-893908324 None] Created volume successfully. Jul 06 20:57:16 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.657s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:57:16 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] Deleted volume successfully. Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2bee66dc-5875-4d8d-a87f-3965bf469f36 tempest-VolumesActionsTest-1783688265 None] Lock "cinder-606ba92e-3b52-49bc-b6d9-35690882d12e-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:16 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc13b475-0006-4b7a-9e34-234c35e41401 1073741824" returned: 0 in 0.873s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc13b475-0006-4b7a-9e34-234c35e41401 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:16 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc13b475-0006-4b7a-9e34-234c35e41401 Jul 06 20:57:16 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Flow 'volume_create_manager' (454a0cf2-92f8-4973-bff4-2aa2233c49b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9c5c9e-7436-4b29-811c-ab1131030545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9c5c9e-7436-4b29-811c-ab1131030545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2125341395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3623059-c079-495a-8721-024c7f9116aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d859ca0f0484696a44afe545f070da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:17Z,use_quota=True,user_id='f9e30844bf2f4488bde51e37664cab69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f01bee-1391-467a-a989-34a33d600bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f01bee-1391-467a-a989-34a33d600bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd41cbe0-0080-407b-aba0-049d37545baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd41cbe0-0080-407b-aba0-049d37545baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3623059-c079-495a-8721-024c7f9116aa', 'volume_name': 'volume-a3623059-c079-495a-8721-024c7f9116aa', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928aea79-7d57-4724-83f8-dce73f8f090c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928aea79-7d57-4724-83f8-dce73f8f090c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fadcbcb-9ec9-4463-88ee-7bba79cd8d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:17 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Volume a3623059-c079-495a-8721-024c7f9116aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3623059-c079-495a-8721-024c7f9116aa', 'volume_size': 1} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:17 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc13b475-0006-4b7a-9e34-234c35e41401" returned: 0 in 0.642s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.632s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] Creating offline snapshot aeaeb70b-667e-45fd-8995-9c15a7a38dce of volume 68ca64bc-20ea-4cf4-b951-832c82102f61 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581fd83c-7b68-46e3-abfc-a5b82d2c5064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc13b475-0006-4b7a-9e34-234c35e41401', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8275c84b-4ace-4e10-89f1-b1a25f87296d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edd08e6-fdf4-4aee-b473-14e5c2a4d9bd]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:17 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Volume volume-dc13b475-0006-4b7a-9e34-234c35e41401 (dc13b475-0006-4b7a-9e34-234c35e41401): created successfully Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8275c84b-4ace-4e10-89f1-b1a25f87296d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Flow 'volume_create_manager' (6c607f3e-c4a5-4bf4-9352-5352839c0179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:17 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9b93fcf4-e410-41de-ab46-540667b3e0f3 tempest-CreateVolumesFromImageTest-893908324 None] Created volume successfully. Jul 06 20:57:17 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 Jul 06 20:57:17 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "cinder-dc13b475-0006-4b7a-9e34-234c35e41401-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-dc13b475-0006-4b7a-9e34-234c35e41401-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "cinder-quobyte-dc13b475-0006-4b7a-9e34-234c35e41401" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-quobyte-dc13b475-0006-4b7a-9e34-234c35e41401" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfa61af-8ed7-4131-b0a5-668924398b2d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc13b475-0006-4b7a-9e34-234c35e41401 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:18 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc13b475-0006-4b7a-9e34-234c35e41401 Jul 06 20:57:18 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:18 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61" returned: 0 in 0.813s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:18 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce 1G Jul 06 20:57:18 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:18 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc13b475-0006-4b7a-9e34-234c35e41401" returned: 0 in 0.750s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc13b475-0006-4b7a-9e34-234c35e41401 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:18 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc13b475-0006-4b7a-9e34-234c35e41401 Jul 06 20:57:18 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:19 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce 1G" returned: 0 in 0.796s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68ca64bc-20ea-4cf4-b951-832c82102f61 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:19 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68ca64bc-20ea-4cf4-b951-832c82102f61 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce Jul 06 20:57:19 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:19 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc13b475-0006-4b7a-9e34-234c35e41401" returned: 0 in 0.679s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-quobyte-dc13b475-0006-4b7a-9e34-234c35e41401" released by "delete_volume" :: held 1.469s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:19 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] Created reservations ['fb1cc109-ef3c-420e-b549-97a8283a4246', 'c2d85d16-0b63-4b73-8c41-e0bcd630ad3c', 'a92712f7-ce5a-47f5-913d-207fda904a57', '8b278169-829b-4be3-9be4-650280c09c06'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:19 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:19 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:19 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:57:19 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:19 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68ca64bc-20ea-4cf4-b951-832c82102f61 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce" returned: 0 in 0.659s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:19 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce is being set with open permissions: ugo+rw Jul 06 20:57:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:19 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce Jul 06 20:57:19 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "cinder-b63f5cfc-a025-4c6d-aec5-34babd3c1416-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-b63f5cfc-a025-4c6d-aec5-34babd3c1416-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "cinder-quobyte-b63f5cfc-a025-4c6d-aec5-34babd3c1416" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:20 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.660s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:20 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:57:20 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] Deleted volume successfully. Jul 06 20:57:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-quobyte-b63f5cfc-a025-4c6d-aec5-34babd3c1416" acquired by "delete_volume" :: waited 0.026s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-659eaf1c-f619-434e-abbc-7ee36a809bad tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-dc13b475-0006-4b7a-9e34-234c35e41401-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:20 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f199c26-2a1e-4be5-9d9e-373c7039ca6e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b63f5cfc-a025-4c6d-aec5-34babd3c1416 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:20 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b63f5cfc-a025-4c6d-aec5-34babd3c1416 Jul 06 20:57:20 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:20 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce" returned: 0 in 0.695s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:20 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.info Jul 06 20:57:20 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:20 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b63f5cfc-a025-4c6d-aec5-34babd3c1416" returned: 0 in 0.752s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b63f5cfc-a025-4c6d-aec5-34babd3c1416 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:20 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b63f5cfc-a025-4c6d-aec5-34babd3c1416 Jul 06 20:57:20 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:21 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.info" returned: 0 in 0.681s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:21 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.info is being set with open permissions: ugo+rw Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:21 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.info Jul 06 20:57:21 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:21 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b63f5cfc-a025-4c6d-aec5-34babd3c1416" returned: 0 in 0.699s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-quobyte-b63f5cfc-a025-4c6d-aec5-34babd3c1416" released by "delete_volume" :: held 1.506s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] Created reservations ['a97cbe93-f569-473e-98ab-f020e4736153', 'e0c6e48e-9c03-4bcc-9ad1-001a8b1bb43a', '21ba7751-9989-42f8-bd0c-bb2213893fcc', 'c6861b36-6cd3-4533-a73b-9baf093f839c'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:21 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:57:21 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:21 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.info" returned: 0 in 0.626s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.363s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.711s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2125341395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3623059-c079-495a-8721-024c7f9116aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d859ca0f0484696a44afe545f070da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:17Z,use_quota=True,user_id='f9e30844bf2f4488bde51e37664cab69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Creating volume a3623059-c079-495a-8721-024c7f9116aa {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:21 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:57:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a3623059-c079-495a-8721-024c7f9116aa 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:21 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a3623059-c079-495a-8721-024c7f9116aa 1073741824 Jul 06 20:57:21 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:22 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-25124ef7-f01e-49da-9d26-ee0de52878ea tempest-VolumesDeleteCascade-773702482 None] Create snapshot completed successfully Jul 06 20:57:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "cinder-87981e1a-c9f7-4884-bdb6-ad02863f8415-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-87981e1a-c9f7-4884-bdb6-ad02863f8415-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "cinder-quobyte-87981e1a-c9f7-4884-bdb6-ad02863f8415" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-quobyte-87981e1a-c9f7-4884-bdb6-ad02863f8415" acquired by "delete_volume" :: waited 0.034s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:22 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.673s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:22 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:57:22 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] Deleted volume successfully. Jul 06 20:57:22 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded109f1-f2c4-42b2-9af5-e8dee1c85ce0]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87981e1a-c9f7-4884-bdb6-ad02863f8415 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-da3b125a-89f9-45bc-9637-f09b567092a0 tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-b63f5cfc-a025-4c6d-aec5-34babd3c1416-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:22 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87981e1a-c9f7-4884-bdb6-ad02863f8415 Jul 06 20:57:22 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:22 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a3623059-c079-495a-8721-024c7f9116aa 1073741824" returned: 0 in 0.937s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a3623059-c079-495a-8721-024c7f9116aa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:22 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a3623059-c079-495a-8721-024c7f9116aa Jul 06 20:57:22 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Flow 'volume_create_manager' (948e4139-38e1-4bbb-90f1-720b1c4a80f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360af71a-ca05-487f-b772-ff239550b1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360af71a-ca05-487f-b772-ff239550b1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-489872822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d97325-8281-4ac6-9923-f608db2fd788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d13cb8cb3e9495a80f9cbf73357b22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aeaeb70b-667e-45fd-8995-9c15a7a38dce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:23Z,use_quota=True,user_id='f488dbeb7f594b2b908755adf0576e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf4c7c4-3761-4ee5-9556-95e6b82a132e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf4c7c4-3761-4ee5-9556-95e6b82a132e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1902046e-0ff4-413f-9622-c392279ff0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1902046e-0ff4-413f-9622-c392279ff0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c0d97325-8281-4ac6-9923-f608db2fd788', 'volume_name': 'volume-c0d97325-8281-4ac6-9923-f608db2fd788', 'volume_size': 1, 'snapshot_id': 'aeaeb70b-667e-45fd-8995-9c15a7a38dce'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34a921f-daf1-4b43-b91d-f4141c933a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34a921f-daf1-4b43-b91d-f4141c933a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1e24c4-4330-4f41-a55f-8b8638cb2bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:23 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Volume c0d97325-8281-4ac6-9923-f608db2fd788: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c0d97325-8281-4ac6-9923-f608db2fd788', 'volume_size': 1, 'snapshot_id': 'aeaeb70b-667e-45fd-8995-9c15a7a38dce'} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:23 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87981e1a-c9f7-4884-bdb6-ad02863f8415" returned: 0 in 0.815s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87981e1a-c9f7-4884-bdb6-ad02863f8415 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:23 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87981e1a-c9f7-4884-bdb6-ad02863f8415 Jul 06 20:57:23 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:23 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a3623059-c079-495a-8721-024c7f9116aa" returned: 0 in 0.725s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.476s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "cinder-quobyte-aeaeb70b-667e-45fd-8995-9c15a7a38dce-c0d97325-8281-4ac6-9923-f608db2fd788" by "_create_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fadcbcb-9ec9-4463-88ee-7bba79cd8d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3623059-c079-495a-8721-024c7f9116aa', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525d8b05-5b15-4411-aba2-fce92832fb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-aeaeb70b-667e-45fd-8995-9c15a7a38dce-c0d97325-8281-4ac6-9923-f608db2fd788" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Creating volume c0d97325-8281-4ac6-9923-f608db2fd788 from snapshot aeaeb70b-667e-45fd-8995-9c15a7a38dce {{(pid=87207) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "cinder-quobyte-c0d97325-8281-4ac6-9923-f608db2fd788" by "_copy_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-c0d97325-8281-4ac6-9923-f608db2fd788" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] snapshot: aeaeb70b-667e-45fd-8995-9c15a7a38dce, volume: c0d97325-8281-4ac6-9923-f608db2fd788, {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 20:57:23 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Volume volume-a3623059-c079-495a-8721-024c7f9116aa (a3623059-c079-495a-8721-024c7f9116aa): created successfully Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525d8b05-5b15-4411-aba2-fce92832fb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Flow 'volume_create_manager' (454a0cf2-92f8-4973-bff4-2aa2233c49b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:23 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-5f88e602-1b25-4d78-93b0-218cca87fd3d tempest-VolumesActionsTest-2024396447 None] Created volume successfully. Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26a2abd-f7ac-4689-ad7d-bf3b26a0f2db]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:23 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87981e1a-c9f7-4884-bdb6-ad02863f8415" returned: 0 in 0.629s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:23 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce Jul 06 20:57:23 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-quobyte-87981e1a-c9f7-4884-bdb6-ad02863f8415" released by "delete_volume" :: held 1.499s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:23 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] Created reservations ['b935d4e0-a185-4c15-8981-53eb12e15aae', '5c135e14-f45b-4a74-b98f-b9de81fd7a1d', '83a0c947-1d11-4a54-8780-5454c7cd027e', 'cce091ce-67f0-44b0-b05e-256a8e86595d'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:24 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:57:24 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "cinder-3b44b652-4ce3-4cbb-be17-83b94d336ce9-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:24 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce" returned: 0 in 0.819s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68ca64bc-20ea-4cf4-b951-832c82102f61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Creating direct copy from snapshot {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-3b44b652-4ce3-4cbb-be17-83b94d336ce9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[873f116a-9c68-4b33-96d4-62d20008749c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "cinder-quobyte-3b44b652-4ce3-4cbb-be17-83b94d336ce9" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-quobyte-3b44b652-4ce3-4cbb-be17-83b94d336ce9" acquired by "delete_volume" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:24 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] Acquiring lock "cinder-a3623059-c079-495a-8721-024c7f9116aa-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.742s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:57:24 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 Jul 06 20:57:24 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d671cf-97df-4e9e-8c04-185100a12fc7]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:24 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] Deleted volume successfully. Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3b44b652-4ce3-4cbb-be17-83b94d336ce9 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] Lock "cinder-a3623059-c079-495a-8721-024c7f9116aa-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ba6221ac-0f18-40ff-8d1b-fc534963886e tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-87981e1a-c9f7-4884-bdb6-ad02863f8415-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] Acquiring lock "cinder-quobyte-a3623059-c079-495a-8721-024c7f9116aa" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] Lock "cinder-quobyte-a3623059-c079-495a-8721-024c7f9116aa" acquired by "delete_volume" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce3f923-a8ca-4c38-8a31-ce094c5d71df]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a3623059-c079-495a-8721-024c7f9116aa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:24 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3b44b652-4ce3-4cbb-be17-83b94d336ce9 Jul 06 20:57:24 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:25 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a3623059-c079-495a-8721-024c7f9116aa Jul 06 20:57:25 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:25 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61" returned: 0 in 0.861s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:25 devstack cinder-volume[87207]: DEBUG cinder.utils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Path /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c0d97325-8281-4ac6-9923-f608db2fd788 not found in is_blk_device check {{(pid=87207) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 20:57:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c0d97325-8281-4ac6-9923-f608db2fd788 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:25 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c0d97325-8281-4ac6-9923-f608db2fd788 Jul 06 20:57:25 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:25 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3b44b652-4ce3-4cbb-be17-83b94d336ce9" returned: 0 in 0.759s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3b44b652-4ce3-4cbb-be17-83b94d336ce9 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:25 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3b44b652-4ce3-4cbb-be17-83b94d336ce9 Jul 06 20:57:25 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:25 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a3623059-c079-495a-8721-024c7f9116aa" returned: 0 in 0.826s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a3623059-c079-495a-8721-024c7f9116aa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:25 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a3623059-c079-495a-8721-024c7f9116aa Jul 06 20:57:25 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:26 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3b44b652-4ce3-4cbb-be17-83b94d336ce9" returned: 0 in 0.626s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:26 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-quobyte-3b44b652-4ce3-4cbb-be17-83b94d336ce9" released by "delete_volume" :: held 1.450s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:26 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] Created reservations ['8dc7b502-9ea7-4682-a8ab-a518ee506f5e', '69e6c239-7125-43fd-9c69-847db33de95b', '847b4cf2-e57c-4329-8059-d7620d9f9eb6', 'bfd0df56-3d4f-4da0-8045-f486e2d05257'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:26 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:57:26 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:26 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a3623059-c079-495a-8721-024c7f9116aa" returned: 0 in 0.797s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:26 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] Lock "cinder-quobyte-a3623059-c079-495a-8721-024c7f9116aa" released by "delete_volume" :: held 1.696s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:26 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] Created reservations ['32a3d15b-2322-4d88-b447-721323f027c9', 'd9b995fc-de6a-42f6-8560-ea649b1adddf', 'bb854f24-dc8c-4ee2-9336-758fd300b61c', '14d55254-92f8-4c6d-a6b0-3f427f6ea9c2'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "cinder-768ef377-94f6-4399-ad91-06040a5da5dd-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:27 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:57:27 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-768ef377-94f6-4399-ad91-06040a5da5dd-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "cinder-quobyte-768ef377-94f6-4399-ad91-06040a5da5dd" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-quobyte-768ef377-94f6-4399-ad91-06040a5da5dd" acquired by "delete_volume" :: waited 0.063s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:27 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7668d0e-d39f-4ad7-b8a6-69dc7b4b3821]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-768ef377-94f6-4399-ad91-06040a5da5dd {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:27 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.430s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:27 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:57:27 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-768ef377-94f6-4399-ad91-06040a5da5dd Jul 06 20:57:27 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:27 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] Deleted volume successfully. Jul 06 20:57:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d618c278-db7b-456a-b701-e74449df708a tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-3b44b652-4ce3-4cbb-be17-83b94d336ce9-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:29 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:29 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Flow 'volume_create_manager' (3040e829-ad9b-4ffe-828d-04dab65f7e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a12d9f8-7561-4e1e-9c6e-eee8708adf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-768ef377-94f6-4399-ad91-06040a5da5dd" returned: 0 in 1.875s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-768ef377-94f6-4399-ad91-06040a5da5dd {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:29 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a12d9f8-7561-4e1e-9c6e-eee8708adf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1715127980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ab0771-ec38-44fb-ba8b-c3664c32adeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d859ca0f0484696a44afe545f070da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:29Z,use_quota=True,user_id='f9e30844bf2f4488bde51e37664cab69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:29 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-768ef377-94f6-4399-ad91-06040a5da5dd Jul 06 20:57:29 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53950032-4d1d-411d-bd2d-adf1bc6cf116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53950032-4d1d-411d-bd2d-adf1bc6cf116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb4e597-6eb5-4fd7-843d-6e8a7345d2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb4e597-6eb5-4fd7-843d-6e8a7345d2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87ab0771-ec38-44fb-ba8b-c3664c32adeb', 'volume_name': 'volume-87ab0771-ec38-44fb-ba8b-c3664c32adeb', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124ab9fd-7675-42d0-abcc-a008c45d8ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124ab9fd-7675-42d0-abcc-a008c45d8ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a808ae-ad7c-4577-8570-9c16b77a24a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:29 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Volume 87ab0771-ec38-44fb-ba8b-c3664c32adeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87ab0771-ec38-44fb-ba8b-c3664c32adeb', 'volume_size': 1} Jul 06 20:57:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 2.628s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:29 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:57:29 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] Deleted volume successfully. Jul 06 20:57:29 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-86171c06-a8be-4a3c-8658-a1a98a9b7541 tempest-VolumesActionsTest-1783688265 None] Lock "cinder-a3623059-c079-495a-8721-024c7f9116aa-delete_volume" released by "delete_volume" :: held 4.854s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:30 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-768ef377-94f6-4399-ad91-06040a5da5dd" returned: 0 in 1.132s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:30 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-quobyte-768ef377-94f6-4399-ad91-06040a5da5dd" released by "delete_volume" :: held 3.130s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:30 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] Created reservations ['4de54c35-2aea-4d22-a916-58a2b4f10b40', '510ce7dd-abc6-4bab-a47b-4438ef183c8d', '2cc32cc1-b033-4f52-ba7e-fdc4f22c981f', '49c0d6d4-ca06-4122-827b-eb34cab11676'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:30 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:57:30 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:31 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c0d97325-8281-4ac6-9923-f608db2fd788" returned: 0 in 5.684s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:31 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10be3cc-c091-4c41-ba36-6b4225c34de9]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:31 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 Jul 06 20:57:31 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:31 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.881s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:31 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:57:31 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] Deleted volume successfully. Jul 06 20:57:31 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-faba160f-13b1-4d74-8246-1dd2e07e93b2 tempest-CreateVolumesFromImageTest-893908324 None] Lock "cinder-768ef377-94f6-4399-ad91-06040a5da5dd-delete_volume" released by "delete_volume" :: held 4.555s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:32 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61" returned: 0 in 0.969s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Image conversion details: src /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c0d97325-8281-4ac6-9923-f608db2fd788 {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 20:57:32 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Converted 1024.00 MB image at 180.10 MB/s Jul 06 20:57:32 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c0d97325-8281-4ac6-9923-f608db2fd788 is being set with open permissions: ugo+rw Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c0d97325-8281-4ac6-9923-f608db2fd788 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:32 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c0d97325-8281-4ac6-9923-f608db2fd788 Jul 06 20:57:32 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:32 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c0d97325-8281-4ac6-9923-f608db2fd788" returned: 0 in 0.643s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-c0d97325-8281-4ac6-9923-f608db2fd788" released by "_copy_volume_from_snapshot" :: held 9.118s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-aeaeb70b-667e-45fd-8995-9c15a7a38dce-c0d97325-8281-4ac6-9923-f608db2fd788" released by "_create_volume_from_snapshot" :: held 9.154s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.191s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.254s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1715127980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ab0771-ec38-44fb-ba8b-c3664c32adeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d859ca0f0484696a44afe545f070da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:29Z,use_quota=True,user_id='f9e30844bf2f4488bde51e37664cab69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Creating volume 87ab0771-ec38-44fb-ba8b-c3664c32adeb {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:32 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87ab0771-ec38-44fb-ba8b-c3664c32adeb 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:32 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87ab0771-ec38-44fb-ba8b-c3664c32adeb 1073741824 Jul 06 20:57:32 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1e24c4-4330-4f41-a55f-8b8638cb2bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0d97325-8281-4ac6-9923-f608db2fd788', 'volume_size': 1, 'snapshot_id': 'aeaeb70b-667e-45fd-8995-9c15a7a38dce'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a87241a-915b-4d40-829a-216dc9d39a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:32 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Volume volume-c0d97325-8281-4ac6-9923-f608db2fd788 (c0d97325-8281-4ac6-9923-f608db2fd788): created successfully Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a87241a-915b-4d40-829a-216dc9d39a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:32 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Flow 'volume_create_manager' (948e4139-38e1-4bbb-90f1-720b1c4a80f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:32 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-76b33042-7fcf-4cd2-9451-15ce9eb6d754 tempest-VolumesDeleteCascade-773702482 None] Created volume successfully. Jul 06 20:57:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "cinder-68ca64bc-20ea-4cf4-b951-832c82102f61-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-68ca64bc-20ea-4cf4-b951-832c82102f61-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Performing cascade delete. {{(pid=87207) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 06 20:57:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "cinder-aeaeb70b-667e-45fd-8995-9c15a7a38dce-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-aeaeb70b-667e-45fd-8995-9c15a7a38dce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "cinder-quobyte-68ca64bc-20ea-4cf4-b951-832c82102f61" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-68ca64bc-20ea-4cf4-b951-832c82102f61" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "cinder-quobyte-aeaeb70b-667e-45fd-8995-9c15a7a38dce" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-aeaeb70b-667e-45fd-8995-9c15a7a38dce" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Deleting offline snapshot aeaeb70b-667e-45fd-8995-9c15a7a38dce of volume 68ca64bc-20ea-4cf4-b951-832c82102f61 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:57:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] snapshot_file for this snap is: volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:57:33 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[162ac3ba-b81c-47f2-9b51-d9df2e010639]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:33 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce Jul 06 20:57:33 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:33 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87ab0771-ec38-44fb-ba8b-c3664c32adeb 1073741824" returned: 0 in 1.027s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87ab0771-ec38-44fb-ba8b-c3664c32adeb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:33 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87ab0771-ec38-44fb-ba8b-c3664c32adeb Jul 06 20:57:33 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:33 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Flow 'volume_create_manager' (94c8c4e4-3fc7-4a1b-8730-9e14e8cd506c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1329cc63-37c0-476a-b1d9-2560b20e602b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1329cc63-37c0-476a-b1d9-2560b20e602b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-826232829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5528e62b-23d7-4a1e-9e86-a3a5027f9d8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db64d481941d44a7bcd17fddf24fb3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:34Z,use_quota=True,user_id='1b3876c9ceda4100926d20961f6c8e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (886ab44a-3ca0-4d9a-8e5f-8365646942a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (886ab44a-3ca0-4d9a-8e5f-8365646942a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62eea644-9833-4e5b-a9bf-17ee90d799ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62eea644-9833-4e5b-a9bf-17ee90d799ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5528e62b-23d7-4a1e-9e86-a3a5027f9d8b', 'volume_name': 'volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4fdd9c-f183-4268-81a7-049cb49db2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4fdd9c-f183-4268-81a7-049cb49db2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05403013-41d1-4e12-848a-9ff66c20c647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:34 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Volume 5528e62b-23d7-4a1e-9e86-a3a5027f9d8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b', 'volume_size': 1} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:34 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce" returned: 0 in 0.843s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68ca64bc-20ea-4cf4-b951-832c82102f61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[624d6179-5c3a-42c9-b6a5-19f5ce2df379]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:34 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 Jul 06 20:57:34 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:34 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87ab0771-ec38-44fb-ba8b-c3664c32adeb" returned: 0 in 0.680s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.574s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-826232829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5528e62b-23d7-4a1e-9e86-a3a5027f9d8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db64d481941d44a7bcd17fddf24fb3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:34Z,use_quota=True,user_id='1b3876c9ceda4100926d20961f6c8e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Creating volume 5528e62b-23d7-4a1e-9e86-a3a5027f9d8b {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:34 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:34 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b 1073741824 Jul 06 20:57:34 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a808ae-ad7c-4577-8570-9c16b77a24a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ab0771-ec38-44fb-ba8b-c3664c32adeb', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58ba471-93b9-4655-add6-39450a02abd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:34 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Volume volume-87ab0771-ec38-44fb-ba8b-c3664c32adeb (87ab0771-ec38-44fb-ba8b-c3664c32adeb): created successfully Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58ba471-93b9-4655-add6-39450a02abd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Flow 'volume_create_manager' (3040e829-ad9b-4ffe-828d-04dab65f7e23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:34 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-40d094df-1797-4884-9b91-db32f13587e9 tempest-VolumesActionsTest-2024396447 None] Created volume successfully. Jul 06 20:57:35 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61" returned: 0 in 0.744s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:35 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce Jul 06 20:57:35 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:35 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b 1073741824" returned: 0 in 0.896s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:35 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b Jul 06 20:57:35 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] Acquiring lock "cinder-87ab0771-ec38-44fb-ba8b-c3664c32adeb-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:35 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce" returned: 0 in 0.789s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] Lock "cinder-87ab0771-ec38-44fb-ba8b-c3664c32adeb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:36 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce Jul 06 20:57:36 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] Acquiring lock "cinder-quobyte-87ab0771-ec38-44fb-ba8b-c3664c32adeb" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] Lock "cinder-quobyte-87ab0771-ec38-44fb-ba8b-c3664c32adeb" acquired by "delete_volume" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[07447ce8-f1bb-4ff9-a6d6-e3f53681a2d6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87ab0771-ec38-44fb-ba8b-c3664c32adeb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:36 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87ab0771-ec38-44fb-ba8b-c3664c32adeb Jul 06 20:57:36 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:36 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b" returned: 0 in 0.690s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05403013-41d1-4e12-848a-9ff66c20c647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8286b6b4-4382-481f-af15-3d4a03e1bfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:36 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Volume volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b (5528e62b-23d7-4a1e-9e86-a3a5027f9d8b): created successfully Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8286b6b4-4382-481f-af15-3d4a03e1bfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Flow 'volume_create_manager' (94c8c4e4-3fc7-4a1b-8730-9e14e8cd506c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:36 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0555af04-9e13-4526-9fee-ad8d34756252 tempest-CreateVolumesFromSnapshotTest-598120499 None] Created volume successfully. Jul 06 20:57:36 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61.aeaeb70b-667e-45fd-8995-9c15a7a38dce" returned: 0 in 0.712s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-aeaeb70b-667e-45fd-8995-9c15a7a38dce" released by "_delete_snapshot" :: held 3.181s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-68ca64bc-20ea-4cf4-b951-832c82102f61" released by "delete_snapshot" :: held 3.207s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Created reservations ['561d1818-83de-4cf4-b8d1-8925184530fd', '8141b82a-d5db-463b-85a0-c2dae6e3cf0d', 'dca3b514-4a27-4cc0-abcb-d4d17cd9d9b4', '37570f08-cc3f-4de5-aa0f-177508a4507a'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:36 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Delete snapshot completed successfully. Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-aeaeb70b-667e-45fd-8995-9c15a7a38dce-delete_snapshot" released by "delete_snapshot" :: held 3.351s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Snapshots deleted, issuing volume delete {{(pid=87207) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "cinder-quobyte-68ca64bc-20ea-4cf4-b951-832c82102f61" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-68ca64bc-20ea-4cf4-b951-832c82102f61" acquired by "delete_volume" :: waited 0.013s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:36 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87ab0771-ec38-44fb-ba8b-c3664c32adeb" returned: 0 in 0.824s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87ab0771-ec38-44fb-ba8b-c3664c32adeb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7249f017-54b9-437f-8063-7bbfa8dab41f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:36 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87ab0771-ec38-44fb-ba8b-c3664c32adeb Jul 06 20:57:36 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:37 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 Jul 06 20:57:37 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:37 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] Creating offline snapshot 32b88625-f037-40a7-8d7a-2c6ea81447b0 of volume 5528e62b-23d7-4a1e-9e86-a3a5027f9d8b {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:57:37 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2db961-0a14-40bd-89bf-6cf545a35e95]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:37 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b Jul 06 20:57:37 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:37 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-87ab0771-ec38-44fb-ba8b-c3664c32adeb" returned: 0 in 0.702s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:37 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] Lock "cinder-quobyte-87ab0771-ec38-44fb-ba8b-c3664c32adeb" released by "delete_volume" :: held 1.563s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:37 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] Created reservations ['dc3bb4db-357f-4403-b471-2b776415306d', '342bfd1f-d4dd-4b8b-8caa-2da33824bd3b', '85eec418-268a-4d11-8ac2-fb5f914b9fbc', '409c375f-f7a3-4668-8a35-16a25455dc09'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:37 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61" returned: 0 in 0.811s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:37 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61 Jul 06 20:57:37 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:37 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:37 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:37 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:57:37 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:38 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b" returned: 0 in 0.829s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:38 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0 1G Jul 06 20:57:38 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:38 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-68ca64bc-20ea-4cf4-b951-832c82102f61" returned: 0 in 0.677s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-68ca64bc-20ea-4cf4-b951-832c82102f61" released by "delete_volume" :: held 1.568s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:38 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Created reservations ['48c9bebc-38bd-4d23-b275-f650dc3fff49', '6e0c83fe-db94-45f0-923d-a4ecfa7632b6', 'c8c154d0-6eba-4d9a-b5c7-2833d2460251', '68912737-7a58-44df-98a3-a98d830209d3'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:38 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.771s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:38 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:57:38 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] Deleted volume successfully. Jul 06 20:57:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1b67d7f5-5535-499c-ba21-d4ae207365ca tempest-VolumesActionsTest-2024396447 None] Lock "cinder-87ab0771-ec38-44fb-ba8b-c3664c32adeb-delete_volume" released by "delete_volume" :: held 2.629s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:38 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:57:38 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "cinder-c0d97325-8281-4ac6-9923-f608db2fd788-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-c0d97325-8281-4ac6-9923-f608db2fd788-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "cinder-quobyte-c0d97325-8281-4ac6-9923-f608db2fd788" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-c0d97325-8281-4ac6-9923-f608db2fd788" acquired by "delete_volume" :: waited 0.029s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:39 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[225d6bf0-8f64-4bbd-b155-49264053f729]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c0d97325-8281-4ac6-9923-f608db2fd788 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:39 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0 1G" returned: 0 in 1.044s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:39 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0 Jul 06 20:57:39 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:39 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c0d97325-8281-4ac6-9923-f608db2fd788 Jul 06 20:57:39 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:39 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.850s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:39 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:57:39 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Deleted volume successfully. Jul 06 20:57:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8faf15f6-bd94-4c59-9374-a05dc7afd7b2 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-68ca64bc-20ea-4cf4-b951-832c82102f61-delete_volume" released by "delete_volume" :: held 6.070s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:39 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0" returned: 0 in 0.728s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:39 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0 is being set with open permissions: ugo+rw Jul 06 20:57:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:40 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0 Jul 06 20:57:40 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:40 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c0d97325-8281-4ac6-9923-f608db2fd788" returned: 0 in 0.929s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c0d97325-8281-4ac6-9923-f608db2fd788 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:40 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c0d97325-8281-4ac6-9923-f608db2fd788 Jul 06 20:57:40 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:40 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0" returned: 0 in 0.690s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:40 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.info Jul 06 20:57:40 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:40 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c0d97325-8281-4ac6-9923-f608db2fd788" returned: 0 in 0.702s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-quobyte-c0d97325-8281-4ac6-9923-f608db2fd788" released by "delete_volume" :: held 1.698s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:40 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] Created reservations ['97809b05-7360-41ca-a2f5-0c187e962a15', '59384ecb-5cc6-418f-a583-b7abf3860a86', '95d377e4-b9da-45c1-900b-910dc96a44be', 'a5f9c9dd-ca5f-4f7d-8fea-73ea71c55c20'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:41 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:41 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:41 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:57:41 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:41 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.info" returned: 0 in 0.730s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:41 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.info is being set with open permissions: ugo+rw Jul 06 20:57:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:41 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.info Jul 06 20:57:41 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:41 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.843s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:41 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:57:41 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] Deleted volume successfully. Jul 06 20:57:41 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-522e5d1f-07f4-4465-8db9-47b7155402f0 tempest-VolumesDeleteCascade-773702482 None] Lock "cinder-c0d97325-8281-4ac6-9923-f608db2fd788-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:42 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.info" returned: 0 in 0.887s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.017s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:42 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-381cfbbe-8f93-4544-9d39-49e2ac5ca696 tempest-CreateVolumesFromSnapshotTest-598120499 None] Create snapshot completed successfully Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Flow 'volume_create_manager' (d62bca5d-2145-4f33-96a7-b675666c67dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8889038-0242-49b3-ae3b-1833d9a8d611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8889038-0242-49b3-ae3b-1833d9a8d611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1892162448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc29469-7613-41f8-8f8f-9f799e890a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db64d481941d44a7bcd17fddf24fb3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:43Z,use_quota=True,user_id='1b3876c9ceda4100926d20961f6c8e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0993dcd-4f78-4f99-b043-c7e5eebd9541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0993dcd-4f78-4f99-b043-c7e5eebd9541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cacccc6-0abd-4327-adc1-be0701455ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cacccc6-0abd-4327-adc1-be0701455ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebc29469-7613-41f8-8f8f-9f799e890a80', 'volume_name': 'volume-ebc29469-7613-41f8-8f8f-9f799e890a80', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71d9f62-1480-47bb-8bb9-815760e93cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71d9f62-1480-47bb-8bb9-815760e93cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc633bb-d6cf-4e81-9ba4-01089f33d6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:43 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Volume ebc29469-7613-41f8-8f8f-9f799e890a80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebc29469-7613-41f8-8f8f-9f799e890a80', 'volume_size': 1} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1892162448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc29469-7613-41f8-8f8f-9f799e890a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db64d481941d44a7bcd17fddf24fb3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:43Z,use_quota=True,user_id='1b3876c9ceda4100926d20961f6c8e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Creating volume ebc29469-7613-41f8-8f8f-9f799e890a80 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:43 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ebc29469-7613-41f8-8f8f-9f799e890a80 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:43 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ebc29469-7613-41f8-8f8f-9f799e890a80 1073741824 Jul 06 20:57:43 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Flow 'volume_create_manager' (0cde0ce1-ca8d-4379-bcbb-c40e42eaf294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe797a1-5d91-4149-aad4-d4b986d9dc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe797a1-5d91-4149-aad4-d4b986d9dc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1060982735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592da392-8754-41f2-8833-7c336c61af9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db64d481941d44a7bcd17fddf24fb3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:44Z,use_quota=True,user_id='1b3876c9ceda4100926d20961f6c8e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3073e14c-20ad-4fd1-8512-b1625f4dc1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3073e14c-20ad-4fd1-8512-b1625f4dc1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95665c00-a51c-4b7d-89e1-c1c37dc6a77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95665c00-a51c-4b7d-89e1-c1c37dc6a77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '592da392-8754-41f2-8833-7c336c61af9a', 'volume_name': 'volume-592da392-8754-41f2-8833-7c336c61af9a', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a75df4-5e48-4005-be10-46f5d3d158cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a75df4-5e48-4005-be10-46f5d3d158cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d83fcae-5265-4949-bfd1-341e30be3137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:43 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Volume 592da392-8754-41f2-8833-7c336c61af9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-592da392-8754-41f2-8833-7c336c61af9a', 'volume_size': 1} Jul 06 20:57:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Flow 'volume_create_manager' (1c5761da-45af-4c75-9b5d-88a9d4daa475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb34172-d67d-4251-a437-f36a44183578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb34172-d67d-4251-a437-f36a44183578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1603884450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57532149-c9e8-4e2d-8a88-a104d8788365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db64d481941d44a7bcd17fddf24fb3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:44Z,use_quota=True,user_id='1b3876c9ceda4100926d20961f6c8e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847d3e32-3c9c-4c38-b38f-8d297d673e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847d3e32-3c9c-4c38-b38f-8d297d673e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa54fd0-2258-458d-9db2-3cc4b4dbd9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa54fd0-2258-458d-9db2-3cc4b4dbd9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57532149-c9e8-4e2d-8a88-a104d8788365', 'volume_name': 'volume-57532149-c9e8-4e2d-8a88-a104d8788365', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (142fa7c0-07ac-4863-9f02-79d10fc19f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (142fa7c0-07ac-4863-9f02-79d10fc19f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d59902-e04e-4ef2-8071-d07acc4872ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:44 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Volume 57532149-c9e8-4e2d-8a88-a104d8788365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57532149-c9e8-4e2d-8a88-a104d8788365', 'volume_size': 1} Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:44 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ebc29469-7613-41f8-8f8f-9f799e890a80 1073741824" returned: 0 in 1.335s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=126,cinder:INSERT=40,cinder:UPDATE=192,cinder:DELETE=18 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=140,cinder:UPDATE=172,cinder:INSERT=47,cinder:DELETE=14 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ebc29469-7613-41f8-8f8f-9f799e890a80 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:44 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ebc29469-7613-41f8-8f8f-9f799e890a80 Jul 06 20:57:44 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Flow 'volume_create_manager' (9843cb86-4a2f-42fc-9443-0b5768b5db4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34da3c2c-77f9-4370-ac76-41061086449e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34da3c2c-77f9-4370-ac76-41061086449e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1523849332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d472f3e-dd72-4288-80f2-423fbf0b8156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db64d481941d44a7bcd17fddf24fb3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:45Z,use_quota=True,user_id='1b3876c9ceda4100926d20961f6c8e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ee0f8a-6fab-495e-9556-3703c338688d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ee0f8a-6fab-495e-9556-3703c338688d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1490fa5-37b2-4af7-b70b-7e9740f3031b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1490fa5-37b2-4af7-b70b-7e9740f3031b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d472f3e-dd72-4288-80f2-423fbf0b8156', 'volume_name': 'volume-0d472f3e-dd72-4288-80f2-423fbf0b8156', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0487770c-df41-4dd8-bcd9-33abe2e9bbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0487770c-df41-4dd8-bcd9-33abe2e9bbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf649b33-83ee-487b-b8aa-2367380a9833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:45 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Volume 0d472f3e-dd72-4288-80f2-423fbf0b8156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d472f3e-dd72-4288-80f2-423fbf0b8156', 'volume_size': 1} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Flow 'volume_create_manager' (819e04d2-0bb6-461e-adf7-c793e5561791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00941844-4338-4af1-8d8f-d9abe76017a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00941844-4338-4af1-8d8f-d9abe76017a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1245345396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db64d481941d44a7bcd17fddf24fb3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:45Z,use_quota=True,user_id='1b3876c9ceda4100926d20961f6c8e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed6f0f1-672e-4e1f-a290-16a198258b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed6f0f1-672e-4e1f-a290-16a198258b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59d2def-8f64-4576-8b25-39a5208de9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59d2def-8f64-4576-8b25-39a5208de9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e', 'volume_name': 'volume-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d348465-2fa8-476f-8413-c428437ded03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d348465-2fa8-476f-8413-c428437ded03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16b4411-9350-4334-8950-fa84b108bafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:45 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Volume ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e', 'volume_size': 1} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Flow 'volume_create_manager' (4f94b180-6e4e-48e5-80de-86dc5254a8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96117c7a-83bc-413d-bbd3-3a811185611c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96117c7a-83bc-413d-bbd3-3a811185611c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1321360613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9266ee-7f6a-4a0f-9895-1c17477644c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d9fea9ebc57438fb761625447f3de90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:46Z,use_quota=True,user_id='b14f9714f83f421fa88d1a56173f5cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ef4980-b218-4b59-8402-6b545c0b54cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ef4980-b218-4b59-8402-6b545c0b54cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f012614-0806-4576-ad68-e4f6ee41e5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f012614-0806-4576-ad68-e4f6ee41e5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa9266ee-7f6a-4a0f-9895-1c17477644c5', 'volume_name': 'volume-aa9266ee-7f6a-4a0f-9895-1c17477644c5', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56effe86-eac2-4a86-aa14-6665d0d486b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56effe86-eac2-4a86-aa14-6665d0d486b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9c14b3-a47c-4b1d-9f39-f61416adb819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:45 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Volume aa9266ee-7f6a-4a0f-9895-1c17477644c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa9266ee-7f6a-4a0f-9895-1c17477644c5', 'volume_size': 1} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:45 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ebc29469-7613-41f8-8f8f-9f799e890a80" returned: 0 in 0.994s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] <== create_volume: return (2415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.418s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.866s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1060982735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592da392-8754-41f2-8833-7c336c61af9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db64d481941d44a7bcd17fddf24fb3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:44Z,use_quota=True,user_id='1b3876c9ceda4100926d20961f6c8e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Creating volume 592da392-8754-41f2-8833-7c336c61af9a {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:45 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-592da392-8754-41f2-8833-7c336c61af9a 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:45 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-592da392-8754-41f2-8833-7c336c61af9a 1073741824 Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc633bb-d6cf-4e81-9ba4-01089f33d6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebc29469-7613-41f8-8f8f-9f799e890a80', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:45 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba2b594-b34c-4b67-b707-1cfbdb33e98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:45 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Volume volume-ebc29469-7613-41f8-8f8f-9f799e890a80 (ebc29469-7613-41f8-8f8f-9f799e890a80): created successfully Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba2b594-b34c-4b67-b707-1cfbdb33e98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Flow 'volume_create_manager' (d62bca5d-2145-4f33-96a7-b675666c67dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:45 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-91fbb395-bda1-4c8d-89ac-97e01750a833 tempest-CreateVolumesFromSnapshotTest-598120499 None] Created volume successfully. Jul 06 20:57:46 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-592da392-8754-41f2-8833-7c336c61af9a 1073741824" returned: 0 in 0.868s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-592da392-8754-41f2-8833-7c336c61af9a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:46 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-592da392-8754-41f2-8833-7c336c61af9a Jul 06 20:57:46 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:47 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-592da392-8754-41f2-8833-7c336c61af9a" returned: 0 in 0.662s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:57:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.943s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1603884450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57532149-c9e8-4e2d-8a88-a104d8788365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db64d481941d44a7bcd17fddf24fb3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:44Z,use_quota=True,user_id='1b3876c9ceda4100926d20961f6c8e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:57:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Creating volume 57532149-c9e8-4e2d-8a88-a104d8788365 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:57:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:47 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:57:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-57532149-c9e8-4e2d-8a88-a104d8788365 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d83fcae-5265-4949-bfd1-341e30be3137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-592da392-8754-41f2-8833-7c336c61af9a', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:47 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-57532149-c9e8-4e2d-8a88-a104d8788365 1073741824 Jul 06 20:57:47 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a914be9-d9b8-4709-9a70-56c5c7ce973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:47 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Volume volume-592da392-8754-41f2-8833-7c336c61af9a (592da392-8754-41f2-8833-7c336c61af9a): created successfully Jul 06 20:57:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a914be9-d9b8-4709-9a70-56c5c7ce973a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Flow 'volume_create_manager' (0cde0ce1-ca8d-4379-bcbb-c40e42eaf294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:47 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-ba722217-2951-49dc-872f-03035d7a6e41 tempest-CreateVolumesFromSnapshotTest-598120499 None] Created volume successfully. Jul 06 20:57:48 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-57532149-c9e8-4e2d-8a88-a104d8788365 1073741824" returned: 0 in 0.916s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-57532149-c9e8-4e2d-8a88-a104d8788365 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:48 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-57532149-c9e8-4e2d-8a88-a104d8788365 Jul 06 20:57:48 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:48 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-57532149-c9e8-4e2d-8a88-a104d8788365" returned: 0 in 0.640s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:57:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.911s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1523849332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d472f3e-dd72-4288-80f2-423fbf0b8156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db64d481941d44a7bcd17fddf24fb3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:45Z,use_quota=True,user_id='1b3876c9ceda4100926d20961f6c8e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:57:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Creating volume 0d472f3e-dd72-4288-80f2-423fbf0b8156 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:57:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:48 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:57:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0d472f3e-dd72-4288-80f2-423fbf0b8156 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:48 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0d472f3e-dd72-4288-80f2-423fbf0b8156 1073741824 Jul 06 20:57:48 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d59902-e04e-4ef2-8071-d07acc4872ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57532149-c9e8-4e2d-8a88-a104d8788365', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6780e6-7971-4a62-96bd-3a12875f5335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:49 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Volume volume-57532149-c9e8-4e2d-8a88-a104d8788365 (57532149-c9e8-4e2d-8a88-a104d8788365): created successfully Jul 06 20:57:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6780e6-7971-4a62-96bd-3a12875f5335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Flow 'volume_create_manager' (1c5761da-45af-4c75-9b5d-88a9d4daa475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:49 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d8db8ee0-c9d5-4479-a529-1c578a9075f9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Created volume successfully. Jul 06 20:57:49 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0d472f3e-dd72-4288-80f2-423fbf0b8156 1073741824" returned: 0 in 0.939s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0d472f3e-dd72-4288-80f2-423fbf0b8156 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:49 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0d472f3e-dd72-4288-80f2-423fbf0b8156 Jul 06 20:57:49 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:50 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0d472f3e-dd72-4288-80f2-423fbf0b8156" returned: 0 in 0.709s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:57:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.186s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1245345396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db64d481941d44a7bcd17fddf24fb3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:45Z,use_quota=True,user_id='1b3876c9ceda4100926d20961f6c8e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:57:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Creating volume ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:57:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:50 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:57:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:50 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e 1073741824 Jul 06 20:57:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf649b33-83ee-487b-b8aa-2367380a9833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d472f3e-dd72-4288-80f2-423fbf0b8156', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:50 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ff1b8a-aff2-447f-bb62-39c730be9f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:50 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Volume volume-0d472f3e-dd72-4288-80f2-423fbf0b8156 (0d472f3e-dd72-4288-80f2-423fbf0b8156): created successfully Jul 06 20:57:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ff1b8a-aff2-447f-bb62-39c730be9f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Flow 'volume_create_manager' (9843cb86-4a2f-42fc-9443-0b5768b5db4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:50 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-83cf7c4f-0548-48be-b8f8-5105679110ea tempest-CreateVolumesFromSnapshotTest-598120499 None] Created volume successfully. Jul 06 20:57:51 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e 1073741824" returned: 0 in 0.884s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:51 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e Jul 06 20:57:51 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:52 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e" returned: 0 in 0.718s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.612s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1321360613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9266ee-7f6a-4a0f-9895-1c17477644c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d9fea9ebc57438fb761625447f3de90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:46Z,use_quota=True,user_id='b14f9714f83f421fa88d1a56173f5cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Creating volume aa9266ee-7f6a-4a0f-9895-1c17477644c5 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:52 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-aa9266ee-7f6a-4a0f-9895-1c17477644c5 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16b4411-9350-4334-8950-fa84b108bafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:52 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-aa9266ee-7f6a-4a0f-9895-1c17477644c5 1073741824 Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2db1561-894e-4719-8c11-76acbb2be5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:52 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:52 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Volume volume-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e (ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e): created successfully Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2db1561-894e-4719-8c11-76acbb2be5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Flow 'volume_create_manager' (819e04d2-0bb6-461e-adf7-c793e5561791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:52 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-daece56a-38b2-4597-b706-6713724556c7 tempest-CreateVolumesFromSnapshotTest-598120499 None] Created volume successfully. Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "cinder-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:53 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "cinder-quobyte-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:53 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-quobyte-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e" acquired by "delete_volume" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:53 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae0f5fa-3a68-4426-ac56-32b622931b12]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:53 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e Jul 06 20:57:53 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:53 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-aa9266ee-7f6a-4a0f-9895-1c17477644c5 1073741824" returned: 0 in 0.889s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-aa9266ee-7f6a-4a0f-9895-1c17477644c5 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:53 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-aa9266ee-7f6a-4a0f-9895-1c17477644c5 Jul 06 20:57:53 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:53 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e" returned: 0 in 0.826s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:53 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e Jul 06 20:57:53 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:53 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-aa9266ee-7f6a-4a0f-9895-1c17477644c5" returned: 0 in 0.674s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:57:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9c14b3-a47c-4b1d-9f39-f61416adb819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa9266ee-7f6a-4a0f-9895-1c17477644c5', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d235b2-5035-45f1-ab9f-fade51bb6a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:53 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Volume volume-aa9266ee-7f6a-4a0f-9895-1c17477644c5 (aa9266ee-7f6a-4a0f-9895-1c17477644c5): created successfully Jul 06 20:57:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d235b2-5035-45f1-ab9f-fade51bb6a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Flow 'volume_create_manager' (4f94b180-6e4e-48e5-80de-86dc5254a8f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:54 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-cc5e5dee-8ec9-49a0-854d-ad11b530a3cc tempest-VolumesMetadataTest-1150924575 None] Created volume successfully. Jul 06 20:57:54 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e" returned: 0 in 0.698s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-quobyte-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e" released by "delete_volume" :: held 1.567s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:54 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] Created reservations ['66de263b-7761-44fc-a715-7b6392c3d2a7', '78966ad4-a48e-43c6-af67-77ef9c3de041', 'd857870d-09c4-41c7-bcad-fb79d27a0204', 'd5278633-1c46-4243-b3dd-f205ac9124ed'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:54 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:57:54 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "cinder-0d472f3e-dd72-4288-80f2-423fbf0b8156-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-0d472f3e-dd72-4288-80f2-423fbf0b8156-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "cinder-quobyte-0d472f3e-dd72-4288-80f2-423fbf0b8156" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-quobyte-0d472f3e-dd72-4288-80f2-423fbf0b8156" acquired by "delete_volume" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[29862cf9-2dc5-40c0-8a18-8a1bbd198135]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0d472f3e-dd72-4288-80f2-423fbf0b8156 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Flow 'volume_create_manager' (eb7a910b-6d8e-4107-9e1a-f07803b5d6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (855a41ad-8463-4ea4-b094-3a1262fe0217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (855a41ad-8463-4ea4-b094-3a1262fe0217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1154752761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=def4fc23-3980-4ca0-9678-b5ec6b36002b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d0413e9ac24a5db010975260c5a195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:55Z,use_quota=True,user_id='f877923a6b65430b8a13decc90cc04c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (860a9120-a29f-4a9c-8647-8736a47dbc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (860a9120-a29f-4a9c-8647-8736a47dbc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9254119-c2a9-4b00-afb3-a3f266d04c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9254119-c2a9-4b00-afb3-a3f266d04c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'def4fc23-3980-4ca0-9678-b5ec6b36002b', 'volume_name': 'volume-def4fc23-3980-4ca0-9678-b5ec6b36002b', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:55 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd404742-0075-47c1-9f42-d419d043b60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd404742-0075-47c1-9f42-d419d043b60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d02b185-7d21-4726-a4ec-b359f5fa6632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:55 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Volume def4fc23-3980-4ca0-9678-b5ec6b36002b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-def4fc23-3980-4ca0-9678-b5ec6b36002b', 'volume_size': 1} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1154752761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=def4fc23-3980-4ca0-9678-b5ec6b36002b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d0413e9ac24a5db010975260c5a195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:55Z,use_quota=True,user_id='f877923a6b65430b8a13decc90cc04c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Creating volume def4fc23-3980-4ca0-9678-b5ec6b36002b {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:57:55 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-def4fc23-3980-4ca0-9678-b5ec6b36002b 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:55 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0d472f3e-dd72-4288-80f2-423fbf0b8156 Jul 06 20:57:55 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.782s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:57:55 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] Deleted volume successfully. Jul 06 20:57:55 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-def4fc23-3980-4ca0-9678-b5ec6b36002b 1073741824 Jul 06 20:57:55 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1d776d13-002d-4905-9034-687a506d8916 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-ae335fb7-a6d3-47d0-9797-8c62c0fcbb1e-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] Acquiring lock "cinder-aa9266ee-7f6a-4a0f-9895-1c17477644c5-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] Lock "cinder-aa9266ee-7f6a-4a0f-9895-1c17477644c5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] Acquiring lock "cinder-quobyte-aa9266ee-7f6a-4a0f-9895-1c17477644c5" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:56 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] Lock "cinder-quobyte-aa9266ee-7f6a-4a0f-9895-1c17477644c5" acquired by "delete_volume" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0d472f3e-dd72-4288-80f2-423fbf0b8156" returned: 0 in 0.885s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0d472f3e-dd72-4288-80f2-423fbf0b8156 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:56 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe7cbce-c917-414f-82e0-64628aefd618]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-aa9266ee-7f6a-4a0f-9895-1c17477644c5 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:56 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0d472f3e-dd72-4288-80f2-423fbf0b8156 Jul 06 20:57:56 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:56 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-aa9266ee-7f6a-4a0f-9895-1c17477644c5 Jul 06 20:57:56 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:56 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-def4fc23-3980-4ca0-9678-b5ec6b36002b 1073741824" returned: 0 in 1.004s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-def4fc23-3980-4ca0-9678-b5ec6b36002b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:56 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-def4fc23-3980-4ca0-9678-b5ec6b36002b Jul 06 20:57:56 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:56 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0d472f3e-dd72-4288-80f2-423fbf0b8156" returned: 0 in 0.663s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-quobyte-0d472f3e-dd72-4288-80f2-423fbf0b8156" released by "delete_volume" :: held 1.600s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:56 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] Created reservations ['fc4916dd-8189-4535-8a1e-afe7107ac0c7', '7470981a-1cfd-46bb-9d27-5680e7d029b1', 'a6910b65-c8c7-4e04-9e01-f054dd6a8b0d', 'f9f46a17-4564-4690-a93e-88f2102a0549'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:57 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:57:57 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:57 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-aa9266ee-7f6a-4a0f-9895-1c17477644c5" returned: 0 in 0.857s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-aa9266ee-7f6a-4a0f-9895-1c17477644c5 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:57 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-aa9266ee-7f6a-4a0f-9895-1c17477644c5 Jul 06 20:57:57 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:57 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-def4fc23-3980-4ca0-9678-b5ec6b36002b" returned: 0 in 0.652s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d02b185-7d21-4726-a4ec-b359f5fa6632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-def4fc23-3980-4ca0-9678-b5ec6b36002b', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd224e3-38eb-424f-94ca-c95b2dee0bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:57:57 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Volume volume-def4fc23-3980-4ca0-9678-b5ec6b36002b (def4fc23-3980-4ca0-9678-b5ec6b36002b): created successfully Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd224e3-38eb-424f-94ca-c95b2dee0bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Flow 'volume_create_manager' (eb7a910b-6d8e-4107-9e1a-f07803b5d6f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:57:57 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-cec24cd8-fe58-4758-b2cf-a99638da1a46 tempest-VolumesTransfersV355Test-1789621342 None] Created volume successfully. Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "cinder-57532149-c9e8-4e2d-8a88-a104d8788365-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-57532149-c9e8-4e2d-8a88-a104d8788365-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "cinder-quobyte-57532149-c9e8-4e2d-8a88-a104d8788365" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-quobyte-57532149-c9e8-4e2d-8a88-a104d8788365" acquired by "delete_volume" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[083c465d-97f9-4bf3-92a6-789ee5d34459]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-57532149-c9e8-4e2d-8a88-a104d8788365 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:57 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-57532149-c9e8-4e2d-8a88-a104d8788365 Jul 06 20:57:57 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:57 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-aa9266ee-7f6a-4a0f-9895-1c17477644c5" returned: 0 in 0.759s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] Lock "cinder-quobyte-aa9266ee-7f6a-4a0f-9895-1c17477644c5" released by "delete_volume" :: held 1.690s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:57 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.899s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:57 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:57:57 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] Deleted volume successfully. Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] Created reservations ['952e63df-63fc-4ecd-9582-fa4d47c95dc4', '26d0092e-c781-49d6-8286-2740aaa48530', '91bf482b-8175-450a-aa84-fa6926bb893c', 'b25c3e0b-6854-43b6-b3a4-e3ad59d3e1a4'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-406c011f-30c0-4db8-957d-63b17f32da5f tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-0d472f3e-dd72-4288-80f2-423fbf0b8156-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:58 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:57:58 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:58 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:57:58 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:58 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-acc6e96a-2bae-4065-a658-5a128af88aa3 tempest-VolumesTransfersV355Test-446956753 None] Transfer volume completed successfully. Jul 06 20:57:58 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-57532149-c9e8-4e2d-8a88-a104d8788365" returned: 0 in 0.842s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-57532149-c9e8-4e2d-8a88-a104d8788365 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:58 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-57532149-c9e8-4e2d-8a88-a104d8788365 Jul 06 20:57:58 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:58 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.753s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:57:58 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.704s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:57:58 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] Deleted volume successfully. Jul 06 20:57:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-fc6ab53b-49cb-48df-a1ae-270aa58e1d5c tempest-VolumesMetadataTest-1150924575 None] Lock "cinder-aa9266ee-7f6a-4a0f-9895-1c17477644c5-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:59 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-57532149-c9e8-4e2d-8a88-a104d8788365" returned: 0 in 0.738s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-quobyte-57532149-c9e8-4e2d-8a88-a104d8788365" released by "delete_volume" :: held 1.633s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] Created reservations ['eb386302-2c11-4a91-b786-046fce31a3ef', 'a3119389-7cef-4224-be24-493a987cd7dd', '0749416b-b1ce-46ab-aced-473abb0ce61b', '27de2a47-f122-4cfc-8333-7f4087841ced'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:59 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:57:59 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] Acquiring lock "cinder-def4fc23-3980-4ca0-9678-b5ec6b36002b-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] Lock "cinder-def4fc23-3980-4ca0-9678-b5ec6b36002b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] Acquiring lock "cinder-quobyte-def4fc23-3980-4ca0-9678-b5ec6b36002b" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] Lock "cinder-quobyte-def4fc23-3980-4ca0-9678-b5ec6b36002b" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ff838b-35e3-409b-9504-7e9dd3c91628]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-def4fc23-3980-4ca0-9678-b5ec6b36002b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:57:59 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-def4fc23-3980-4ca0-9678-b5ec6b36002b Jul 06 20:57:59 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "cinder-592da392-8754-41f2-8833-7c336c61af9a-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-592da392-8754-41f2-8833-7c336c61af9a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "cinder-quobyte-592da392-8754-41f2-8833-7c336c61af9a" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:57:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-quobyte-592da392-8754-41f2-8833-7c336c61af9a" acquired by "delete_volume" :: waited 0.031s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:00 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d7c428-7969-4ab5-94b6-6ea28998df68]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-592da392-8754-41f2-8833-7c336c61af9a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:00 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.755s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:00 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:58:00 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] Deleted volume successfully. Jul 06 20:58:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b9b44ecb-18a4-4b13-85bb-30080d949309 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-57532149-c9e8-4e2d-8a88-a104d8788365-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:00 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-592da392-8754-41f2-8833-7c336c61af9a Jul 06 20:58:00 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:00 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-def4fc23-3980-4ca0-9678-b5ec6b36002b" returned: 0 in 0.941s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-def4fc23-3980-4ca0-9678-b5ec6b36002b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:00 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-def4fc23-3980-4ca0-9678-b5ec6b36002b Jul 06 20:58:00 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:00 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-592da392-8754-41f2-8833-7c336c61af9a" returned: 0 in 0.859s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-592da392-8754-41f2-8833-7c336c61af9a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:00 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-592da392-8754-41f2-8833-7c336c61af9a Jul 06 20:58:00 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:01 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-def4fc23-3980-4ca0-9678-b5ec6b36002b" returned: 0 in 0.687s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:01 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] Lock "cinder-quobyte-def4fc23-3980-4ca0-9678-b5ec6b36002b" released by "delete_volume" :: held 1.675s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:01 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] Created reservations ['6cf707ba-319f-4c65-8699-9a1ac3612606', 'b779eb9b-b216-4438-b585-3ba2b4ca8323', '782595cf-c57f-44a1-9b6f-804615e61291', '3518dbb6-4d6d-453d-a411-a1ac6c43fdab'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:58:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:01 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:58:01 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:01 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-592da392-8754-41f2-8833-7c336c61af9a" returned: 0 in 0.744s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:01 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-quobyte-592da392-8754-41f2-8833-7c336c61af9a" released by "delete_volume" :: held 1.675s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:01 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] Created reservations ['076fbd65-4aff-4d8f-99eb-61deb7a22493', 'd031b1d9-a222-4a40-afb4-2af79a9de55c', 'eef7dcbb-0cc3-4ffc-9800-81a8768e6cb6', '0087d8e9-0b04-4205-bbe7-350ed75966a1'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:58:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:01 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:58:01 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:02 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.799s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:58:02 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] Deleted volume successfully. Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "cinder-ebc29469-7613-41f8-8f8f-9f799e890a80-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-76c4b408-6aad-4201-9fa7-7c6820880408 tempest-VolumesTransfersV355Test-1487742223 None] Lock "cinder-def4fc23-3980-4ca0-9678-b5ec6b36002b-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-ebc29469-7613-41f8-8f8f-9f799e890a80-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "cinder-quobyte-ebc29469-7613-41f8-8f8f-9f799e890a80" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-quobyte-ebc29469-7613-41f8-8f8f-9f799e890a80" acquired by "delete_volume" :: waited 0.028s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9c488c-5a57-47a3-915a-90ddf2be7756]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ebc29469-7613-41f8-8f8f-9f799e890a80 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:58:02 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ebc29469-7613-41f8-8f8f-9f799e890a80 Jul 06 20:58:02 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Flow 'volume_create_manager' (d530bcbb-9839-4f66-be12-fcf6679ab766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36995ac0-ba6c-40b7-8e46-b3ed6195627b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36995ac0-ba6c-40b7-8e46-b3ed6195627b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1824823717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eca2a1a-c50d-49b2-9446-51142f7e51cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d0413e9ac24a5db010975260c5a195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:03Z,use_quota=True,user_id='f877923a6b65430b8a13decc90cc04c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a46f531-8f01-4304-ae03-d1b5585023bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a46f531-8f01-4304-ae03-d1b5585023bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d343ea2-e98c-4243-b694-308d1c624d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d343ea2-e98c-4243-b694-308d1c624d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eca2a1a-c50d-49b2-9446-51142f7e51cf', 'volume_name': 'volume-2eca2a1a-c50d-49b2-9446-51142f7e51cf', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f96907c-b91f-4266-8651-4519d7be47b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f96907c-b91f-4266-8651-4519d7be47b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f358e206-9fce-4b26-ae97-b99cf3a5e8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:02 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Volume 2eca2a1a-c50d-49b2-9446-51142f7e51cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eca2a1a-c50d-49b2-9446-51142f7e51cf', 'volume_size': 1} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1824823717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eca2a1a-c50d-49b2-9446-51142f7e51cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d0413e9ac24a5db010975260c5a195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:03Z,use_quota=True,user_id='f877923a6b65430b8a13decc90cc04c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Creating volume 2eca2a1a-c50d-49b2-9446-51142f7e51cf {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:58:02 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2eca2a1a-c50d-49b2-9446-51142f7e51cf 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:02 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.947s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:58:02 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] Deleted volume successfully. Jul 06 20:58:02 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2eca2a1a-c50d-49b2-9446-51142f7e51cf 1073741824 Jul 06 20:58:02 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5031c166-39eb-4e97-8c20-d6c2f50256dc tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-592da392-8754-41f2-8833-7c336c61af9a-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:03 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ebc29469-7613-41f8-8f8f-9f799e890a80" returned: 0 in 0.969s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ebc29469-7613-41f8-8f8f-9f799e890a80 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:03 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ebc29469-7613-41f8-8f8f-9f799e890a80 Jul 06 20:58:03 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:03 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:58:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Flow 'volume_create_manager' (405e66f7-55ba-4a73-8116-c5688b8c9f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79ae2fc-fc74-4ff7-928c-d2579490cdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79ae2fc-fc74-4ff7-928c-d2579490cdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1733312438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf3f176-e9e2-4751-ab29-ed533cf7e859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9849614927694c2ca67bf8e357a00e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:04Z,use_quota=True,user_id='5fea54c53ce04890a9cc5119e1325567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f65da3-1da6-4b88-af4e-516b4597f12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f65da3-1da6-4b88-af4e-516b4597f12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5df4dd-a5f9-4d71-b112-4043ebede4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5df4dd-a5f9-4d71-b112-4043ebede4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cf3f176-e9e2-4751-ab29-ed533cf7e859', 'volume_name': 'volume-9cf3f176-e9e2-4751-ab29-ed533cf7e859', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e13158-3c35-4517-bdb7-d9091c03245b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e13158-3c35-4517-bdb7-d9091c03245b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77dbc835-0708-47a7-8609-e47c59b29ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:03 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Volume 9cf3f176-e9e2-4751-ab29-ed533cf7e859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cf3f176-e9e2-4751-ab29-ed533cf7e859', 'volume_size': 1} Jul 06 20:58:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:03 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2eca2a1a-c50d-49b2-9446-51142f7e51cf 1073741824" returned: 0 in 1.071s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2eca2a1a-c50d-49b2-9446-51142f7e51cf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:03 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2eca2a1a-c50d-49b2-9446-51142f7e51cf Jul 06 20:58:03 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:04 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ebc29469-7613-41f8-8f8f-9f799e890a80" returned: 0 in 0.669s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-quobyte-ebc29469-7613-41f8-8f8f-9f799e890a80" released by "delete_volume" :: held 1.696s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Created reservations ['d9db8db3-10c8-4e90-8e6e-d26d1625e857', 'e3886c5c-f288-44da-9652-9e28d6cb1654', 'c1165d92-fec4-4f29-9686-5e64b1b36b15', 'd9f1fd3b-c672-4c5e-83c5-477885a04de4'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:04 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:58:04 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "cinder-32b88625-f037-40a7-8d7a-2c6ea81447b0-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-32b88625-f037-40a7-8d7a-2c6ea81447b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:04 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "cinder-quobyte-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2eca2a1a-c50d-49b2-9446-51142f7e51cf" returned: 0 in 0.760s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.924s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1733312438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf3f176-e9e2-4751-ab29-ed533cf7e859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9849614927694c2ca67bf8e357a00e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:04Z,use_quota=True,user_id='5fea54c53ce04890a9cc5119e1325567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Creating volume 9cf3f176-e9e2-4751-ab29-ed533cf7e859 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:58:04 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9cf3f176-e9e2-4751-ab29-ed533cf7e859 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-quobyte-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "cinder-quobyte-32b88625-f037-40a7-8d7a-2c6ea81447b0" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:04 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9cf3f176-e9e2-4751-ab29-ed533cf7e859 1073741824 Jul 06 20:58:04 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f358e206-9fce-4b26-ae97-b99cf3a5e8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eca2a1a-c50d-49b2-9446-51142f7e51cf', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f8889c3-6857-4ef7-93f6-8269e12a41c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:04 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Volume volume-2eca2a1a-c50d-49b2-9446-51142f7e51cf (2eca2a1a-c50d-49b2-9446-51142f7e51cf): created successfully Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f8889c3-6857-4ef7-93f6-8269e12a41c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Flow 'volume_create_manager' (d530bcbb-9839-4f66-be12-fcf6679ab766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-quobyte-32b88625-f037-40a7-8d7a-2c6ea81447b0" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] Deleting offline snapshot 32b88625-f037-40a7-8d7a-2c6ea81447b0 of volume 5528e62b-23d7-4a1e-9e86-a3a5027f9d8b {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] snapshot_file for this snap is: volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:58:04 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e56c1b23-1eac-4567-a0b1-835bbf3dae1b tempest-VolumesTransfersV355Test-1789621342 None] Created volume successfully. Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a6b83e-f751-4fba-98b2-8672ba5d970c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:04 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0 Jul 06 20:58:04 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:04 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.676s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:58:04 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Deleted volume successfully. Jul 06 20:58:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dda14d2d-fd5f-4b0f-89fe-d948a84a81d9 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-ebc29469-7613-41f8-8f8f-9f799e890a80-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:05 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9cf3f176-e9e2-4751-ab29-ed533cf7e859 1073741824" returned: 0 in 0.861s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:05 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0" returned: 0 in 0.762s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:58:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9cf3f176-e9e2-4751-ab29-ed533cf7e859 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:05 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b65762-4803-4b1e-8bd4-58888eb3d3d7]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:05 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9cf3f176-e9e2-4751-ab29-ed533cf7e859 Jul 06 20:58:05 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:05 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b Jul 06 20:58:05 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] Acquiring lock "cinder-2eca2a1a-c50d-49b2-9446-51142f7e51cf-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] Lock "cinder-2eca2a1a-c50d-49b2-9446-51142f7e51cf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] Acquiring lock "cinder-quobyte-2eca2a1a-c50d-49b2-9446-51142f7e51cf" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] Lock "cinder-quobyte-2eca2a1a-c50d-49b2-9446-51142f7e51cf" acquired by "delete_volume" :: waited 0.024s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:06 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa11e91-bb75-4ed7-aac1-1f7b3cb21852]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2eca2a1a-c50d-49b2-9446-51142f7e51cf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:06 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2eca2a1a-c50d-49b2-9446-51142f7e51cf Jul 06 20:58:06 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:06 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b" returned: 0 in 0.820s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:06 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9cf3f176-e9e2-4751-ab29-ed533cf7e859" returned: 0 in 0.841s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:58:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:06 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0 Jul 06 20:58:06 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77dbc835-0708-47a7-8609-e47c59b29ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cf3f176-e9e2-4751-ab29-ed533cf7e859', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56a7427-9ce8-4e51-84ac-8ad64b7a0e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:06 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Volume volume-9cf3f176-e9e2-4751-ab29-ed533cf7e859 (9cf3f176-e9e2-4751-ab29-ed533cf7e859): created successfully Jul 06 20:58:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56a7427-9ce8-4e51-84ac-8ad64b7a0e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Flow 'volume_create_manager' (405e66f7-55ba-4a73-8116-c5688b8c9f56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:06 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-5ab4e544-4b4f-439c-923a-3dda0269d0ce tempest-VolumesTransfersTest-1590021625 None] Created volume successfully. Jul 06 20:58:07 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2eca2a1a-c50d-49b2-9446-51142f7e51cf" returned: 0 in 0.829s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2eca2a1a-c50d-49b2-9446-51142f7e51cf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:07 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2eca2a1a-c50d-49b2-9446-51142f7e51cf Jul 06 20:58:07 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:07 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0" returned: 0 in 0.838s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:07 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0 Jul 06 20:58:07 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:07 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-80227328-7f5f-4192-a13a-da2ef2bd7c2f tempest-VolumesTransfersTest-65922376 None] Transfer volume completed successfully. Jul 06 20:58:07 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2eca2a1a-c50d-49b2-9446-51142f7e51cf" returned: 0 in 0.667s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] Lock "cinder-quobyte-2eca2a1a-c50d-49b2-9446-51142f7e51cf" released by "delete_volume" :: held 1.546s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:07 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] Created reservations ['22a7cd11-9fc3-4ba3-9f25-18267db640f6', '7f135f19-e44e-48ba-bf50-426a6f0565a1', 'fc66138c-ea0f-496c-921d-74a21ec49dfd', '99f5c985-9de3-4ecc-9b20-0c384b719181'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:58:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:07 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:58:07 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:07 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b.32b88625-f037-40a7-8d7a-2c6ea81447b0" returned: 0 in 0.667s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-quobyte-32b88625-f037-40a7-8d7a-2c6ea81447b0" released by "_delete_snapshot" :: held 3.226s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-quobyte-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b" released by "delete_snapshot" :: held 3.286s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:08 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] Created reservations ['8d03a00f-4726-4fd0-ba02-cc46778462e1', '71b307f0-7226-4a9b-9195-a171083a3330', '66840962-eae3-4eaf-a98a-93cdae9fdaf0', '97e2d0e4-1472-4a05-abd8-401e8abe09f8'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:58:08 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] Delete snapshot completed successfully. Jul 06 20:58:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f70c73eb-bb41-4091-9e92-4528d18bbb10 tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-32b88625-f037-40a7-8d7a-2c6ea81447b0-delete_snapshot" released by "delete_snapshot" :: held 3.529s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] Acquiring lock "cinder-9cf3f176-e9e2-4751-ab29-ed533cf7e859-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] Lock "cinder-9cf3f176-e9e2-4751-ab29-ed533cf7e859-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] Acquiring lock "cinder-quobyte-9cf3f176-e9e2-4751-ab29-ed533cf7e859" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] Lock "cinder-quobyte-9cf3f176-e9e2-4751-ab29-ed533cf7e859" acquired by "delete_volume" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:08 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4174b943-b650-4aa9-a703-6dda0101777f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9cf3f176-e9e2-4751-ab29-ed533cf7e859 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:08 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.705s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:08 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:58:08 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] Deleted volume successfully. Jul 06 20:58:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ebb61d7f-7a77-4ab8-ab5e-726db2005c6b tempest-VolumesTransfersV355Test-1487742223 None] Lock "cinder-2eca2a1a-c50d-49b2-9446-51142f7e51cf-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:08 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9cf3f176-e9e2-4751-ab29-ed533cf7e859 Jul 06 20:58:08 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "cinder-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "cinder-quobyte-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-quobyte-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b" acquired by "delete_volume" :: waited 0.027s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:09 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c60950-f815-4617-8f6d-288ca246eff6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:09 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b Jul 06 20:58:09 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:09 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9cf3f176-e9e2-4751-ab29-ed533cf7e859" returned: 0 in 0.864s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9cf3f176-e9e2-4751-ab29-ed533cf7e859 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:09 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9cf3f176-e9e2-4751-ab29-ed533cf7e859 Jul 06 20:58:09 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:09 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b" returned: 0 in 0.866s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:09 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b Jul 06 20:58:09 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:10 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9cf3f176-e9e2-4751-ab29-ed533cf7e859" returned: 0 in 0.680s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] Lock "cinder-quobyte-9cf3f176-e9e2-4751-ab29-ed533cf7e859" released by "delete_volume" :: held 1.589s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] Created reservations ['2b17cc11-a24a-4dbb-842f-85a3989d2c15', 'b7945008-5899-42dd-923d-363db8c33099', '4b6ca3be-da28-41c6-a4ce-b123828c6007', 'e772fd6c-3e4d-4d54-98ff-0324ef73c2c4'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:10 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:58:10 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:10 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b" returned: 0 in 0.742s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-quobyte-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b" released by "delete_volume" :: held 1.692s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] Created reservations ['4a052ce3-efe5-405a-8a9c-d8f4f062401c', '76a672e1-3db2-40ca-966f-32e5fac23772', 'a3fc23f3-c7d5-4021-9054-2f7ebcf77254', '885df57a-0c0c-42f3-97de-be17952e0d42'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:10 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:58:10 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:10 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.751s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:10 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:58:10 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] Deleted volume successfully. Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e39598e1-1846-4fa3-be53-50ac27ac3076 tempest-VolumesTransfersTest-1434826280 None] Lock "cinder-9cf3f176-e9e2-4751-ab29-ed533cf7e859-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Flow 'volume_create_manager' (4cb9c412-31c7-400e-84f8-dde71b63647c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a26e776-6dfe-4760-ad55-9acc467ad565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a26e776-6dfe-4760-ad55-9acc467ad565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-134657625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6690ace8-01df-4507-8b0a-d2521268bc45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9849614927694c2ca67bf8e357a00e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:11Z,use_quota=True,user_id='5fea54c53ce04890a9cc5119e1325567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473b684f-8f8f-461d-8f48-a6633d79896f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473b684f-8f8f-461d-8f48-a6633d79896f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b18635c-9d54-425c-bb03-3e0a40c24508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b18635c-9d54-425c-bb03-3e0a40c24508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6690ace8-01df-4507-8b0a-d2521268bc45', 'volume_name': 'volume-6690ace8-01df-4507-8b0a-d2521268bc45', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d3ae01-90b0-4578-8aef-997b3aeca91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d3ae01-90b0-4578-8aef-997b3aeca91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfa4784-c12c-418c-af52-4a077bc78fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:11 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Volume 6690ace8-01df-4507-8b0a-d2521268bc45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6690ace8-01df-4507-8b0a-d2521268bc45', 'volume_size': 1} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-134657625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6690ace8-01df-4507-8b0a-d2521268bc45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9849614927694c2ca67bf8e357a00e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:11Z,use_quota=True,user_id='5fea54c53ce04890a9cc5119e1325567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Creating volume 6690ace8-01df-4507-8b0a-d2521268bc45 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:58:11 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6690ace8-01df-4507-8b0a-d2521268bc45 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:11 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6690ace8-01df-4507-8b0a-d2521268bc45 1073741824 Jul 06 20:58:11 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:11 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.810s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:58:11 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] Deleted volume successfully. Jul 06 20:58:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1e7700ed-7275-4d7a-8423-1c752819d86e tempest-CreateVolumesFromSnapshotTest-598120499 None] Lock "cinder-5528e62b-23d7-4a1e-9e86-a3a5027f9d8b-delete_volume" released by "delete_volume" :: held 2.801s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:12 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6690ace8-01df-4507-8b0a-d2521268bc45 1073741824" returned: 0 in 1.019s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6690ace8-01df-4507-8b0a-d2521268bc45 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:12 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6690ace8-01df-4507-8b0a-d2521268bc45 Jul 06 20:58:12 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:13 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6690ace8-01df-4507-8b0a-d2521268bc45" returned: 0 in 0.736s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:58:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfa4784-c12c-418c-af52-4a077bc78fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6690ace8-01df-4507-8b0a-d2521268bc45', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15fe686b-5e82-494c-afc5-5e4f45edcd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:13 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Volume volume-6690ace8-01df-4507-8b0a-d2521268bc45 (6690ace8-01df-4507-8b0a-d2521268bc45): created successfully Jul 06 20:58:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15fe686b-5e82-494c-afc5-5e4f45edcd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:13 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Flow 'volume_create_manager' (4cb9c412-31c7-400e-84f8-dde71b63647c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:13 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d3995628-0e78-4ad9-adef-d585de6807c6 tempest-VolumesTransfersTest-1590021625 None] Created volume successfully. Jul 06 20:58:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] Acquiring lock "cinder-6690ace8-01df-4507-8b0a-d2521268bc45-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] Lock "cinder-6690ace8-01df-4507-8b0a-d2521268bc45-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] Acquiring lock "cinder-quobyte-6690ace8-01df-4507-8b0a-d2521268bc45" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] Lock "cinder-quobyte-6690ace8-01df-4507-8b0a-d2521268bc45" acquired by "delete_volume" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:14 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57e7b2e-9e56-445e-aeec-1e6d2ea7bfb2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6690ace8-01df-4507-8b0a-d2521268bc45 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:15 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6690ace8-01df-4507-8b0a-d2521268bc45 Jul 06 20:58:15 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:15 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6690ace8-01df-4507-8b0a-d2521268bc45" returned: 0 in 0.818s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6690ace8-01df-4507-8b0a-d2521268bc45 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:15 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6690ace8-01df-4507-8b0a-d2521268bc45 Jul 06 20:58:15 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Flow 'volume_create_manager' (41e69929-aeb2-4284-91d1-e5724c1c137c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9baf82ee-cd04-4959-9ffd-4ee292b7c54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9baf82ee-cd04-4959-9ffd-4ee292b7c54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2027367031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b964488-8ccd-4769-a563-d6de3ec25add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf96afae14654da89e8dd4cf4e79c7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:16Z,use_quota=True,user_id='d12dfe708c434b8d95e90613bdc81248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:16 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab3696bf-3113-431a-8b04-2e3d6dde4385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab3696bf-3113-431a-8b04-2e3d6dde4385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead6646f-180b-4ca2-8d57-d322000ed227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead6646f-180b-4ca2-8d57-d322000ed227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b964488-8ccd-4769-a563-d6de3ec25add', 'volume_name': 'volume-7b964488-8ccd-4769-a563-d6de3ec25add', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07ebbf29-4ba0-4915-8d4e-4039d7349f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07ebbf29-4ba0-4915-8d4e-4039d7349f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85fed606-bb91-486d-b21f-5962809c44c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:16 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Volume 7b964488-8ccd-4769-a563-d6de3ec25add: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b964488-8ccd-4769-a563-d6de3ec25add', 'volume_size': 1} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2027367031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b964488-8ccd-4769-a563-d6de3ec25add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf96afae14654da89e8dd4cf4e79c7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:16Z,use_quota=True,user_id='d12dfe708c434b8d95e90613bdc81248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Creating volume 7b964488-8ccd-4769-a563-d6de3ec25add {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:58:16 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7b964488-8ccd-4769-a563-d6de3ec25add 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6690ace8-01df-4507-8b0a-d2521268bc45" returned: 0 in 0.790s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:16 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7b964488-8ccd-4769-a563-d6de3ec25add 1073741824 Jul 06 20:58:16 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] Lock "cinder-quobyte-6690ace8-01df-4507-8b0a-d2521268bc45" released by "delete_volume" :: held 1.674s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] Created reservations ['ea0c2c43-b27c-4d6b-8e24-259dbbe47321', '175e4f15-8424-4f17-ac17-480280a475ba', '9bd3f1f7-c69f-4c81-a701-f70c62597ef4', '2ff85c6c-e33e-452e-b202-28c292779f27'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:16 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:58:16 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:17 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.771s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:17 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:58:17 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] Deleted volume successfully. Jul 06 20:58:17 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7b964488-8ccd-4769-a563-d6de3ec25add 1073741824" returned: 0 in 0.954s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2eb20a4d-572e-4fcc-bea3-9e33bc64ca8c tempest-VolumesTransfersTest-1434826280 None] Lock "cinder-6690ace8-01df-4507-8b0a-d2521268bc45-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7b964488-8ccd-4769-a563-d6de3ec25add {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:17 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7b964488-8ccd-4769-a563-d6de3ec25add Jul 06 20:58:17 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:18 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7b964488-8ccd-4769-a563-d6de3ec25add" returned: 0 in 0.674s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:58:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85fed606-bb91-486d-b21f-5962809c44c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b964488-8ccd-4769-a563-d6de3ec25add', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99bc8bc5-666c-43d1-a513-2ed3668a951f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:18 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Volume volume-7b964488-8ccd-4769-a563-d6de3ec25add (7b964488-8ccd-4769-a563-d6de3ec25add): created successfully Jul 06 20:58:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99bc8bc5-666c-43d1-a513-2ed3668a951f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:18 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Flow 'volume_create_manager' (41e69929-aeb2-4284-91d1-e5724c1c137c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:18 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-8864b993-46e6-48b9-bd1d-d5ae71951e70 tempest-VolumesTransfersV357Test-1435533381 None] Created volume successfully. Jul 06 20:58:19 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f41b5c74-3b19-48f9-aafb-24dedd8bff6a tempest-VolumesTransfersV357Test-159661649 None] Transfer volume completed successfully. Jul 06 20:58:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] Acquiring lock "cinder-7b964488-8ccd-4769-a563-d6de3ec25add-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] Lock "cinder-7b964488-8ccd-4769-a563-d6de3ec25add-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] Acquiring lock "cinder-quobyte-7b964488-8ccd-4769-a563-d6de3ec25add" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] Lock "cinder-quobyte-7b964488-8ccd-4769-a563-d6de3ec25add" acquired by "delete_volume" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:20 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5c5ab6-7370-4314-881f-ba7f96697895]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7b964488-8ccd-4769-a563-d6de3ec25add {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:20 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7b964488-8ccd-4769-a563-d6de3ec25add Jul 06 20:58:20 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:21 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7b964488-8ccd-4769-a563-d6de3ec25add" returned: 0 in 0.783s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7b964488-8ccd-4769-a563-d6de3ec25add {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:21 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7b964488-8ccd-4769-a563-d6de3ec25add Jul 06 20:58:21 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:22 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7b964488-8ccd-4769-a563-d6de3ec25add" returned: 0 in 0.643s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] Lock "cinder-quobyte-7b964488-8ccd-4769-a563-d6de3ec25add" released by "delete_volume" :: held 1.487s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:22 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] Created reservations ['a4f485cf-6d29-4db8-9087-860503c8e9a3', '3887285a-f2b1-4c14-ac11-2efe21b23f18', '8badd297-d487-4fb1-8bb6-46f645f303db', '9c5a3e06-797c-4f68-9453-fd74117aea5c'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:58:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:22 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:58:22 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:23 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.743s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:58:23 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] Deleted volume successfully. Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-56204843-3b9f-4412-8e6a-c760245dae79 tempest-VolumesTransfersV357Test-946460746 None] Lock "cinder-7b964488-8ccd-4769-a563-d6de3ec25add-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Flow 'volume_create_manager' (ad04fb2a-bd1c-4eb4-b57a-cd2891618a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd282155-254e-41c9-9195-d8437a13bc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd282155-254e-41c9-9195-d8437a13bc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-660986114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4661a72d-b2a7-4bba-844a-d08f707a24c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf96afae14654da89e8dd4cf4e79c7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:23Z,use_quota=True,user_id='d12dfe708c434b8d95e90613bdc81248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d574ff-63fa-4647-9745-1c5c712e9d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d574ff-63fa-4647-9745-1c5c712e9d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7f7a9e-0fbe-41e7-8d56-863f7f601873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7f7a9e-0fbe-41e7-8d56-863f7f601873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4661a72d-b2a7-4bba-844a-d08f707a24c3', 'volume_name': 'volume-4661a72d-b2a7-4bba-844a-d08f707a24c3', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d69e06-cda3-442d-911f-df808da81515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d69e06-cda3-442d-911f-df808da81515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (797602fd-93f8-4366-93ba-bb90642ffd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:23 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Volume 4661a72d-b2a7-4bba-844a-d08f707a24c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4661a72d-b2a7-4bba-844a-d08f707a24c3', 'volume_size': 1} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-660986114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4661a72d-b2a7-4bba-844a-d08f707a24c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf96afae14654da89e8dd4cf4e79c7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:23Z,use_quota=True,user_id='d12dfe708c434b8d95e90613bdc81248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Creating volume 4661a72d-b2a7-4bba-844a-d08f707a24c3 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:58:23 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:58:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4661a72d-b2a7-4bba-844a-d08f707a24c3 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:23 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4661a72d-b2a7-4bba-844a-d08f707a24c3 1073741824 Jul 06 20:58:23 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:24 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4661a72d-b2a7-4bba-844a-d08f707a24c3 1073741824" returned: 0 in 0.845s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4661a72d-b2a7-4bba-844a-d08f707a24c3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:24 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4661a72d-b2a7-4bba-844a-d08f707a24c3 Jul 06 20:58:24 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:25 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4661a72d-b2a7-4bba-844a-d08f707a24c3" returned: 0 in 0.728s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:58:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (797602fd-93f8-4366-93ba-bb90642ffd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4661a72d-b2a7-4bba-844a-d08f707a24c3', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e11f937-56b2-42d9-aad9-0592d349f7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:25 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Volume volume-4661a72d-b2a7-4bba-844a-d08f707a24c3 (4661a72d-b2a7-4bba-844a-d08f707a24c3): created successfully Jul 06 20:58:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e11f937-56b2-42d9-aad9-0592d349f7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Flow 'volume_create_manager' (ad04fb2a-bd1c-4eb4-b57a-cd2891618a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:25 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d2670790-becf-4f0d-9eac-2c393a6b83b6 tempest-VolumesTransfersV357Test-1435533381 None] Created volume successfully. Jul 06 20:58:25 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] Acquiring lock "cinder-4661a72d-b2a7-4bba-844a-d08f707a24c3-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:25 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] Lock "cinder-4661a72d-b2a7-4bba-844a-d08f707a24c3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:25 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] Acquiring lock "cinder-quobyte-4661a72d-b2a7-4bba-844a-d08f707a24c3" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:25 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] Lock "cinder-quobyte-4661a72d-b2a7-4bba-844a-d08f707a24c3" acquired by "delete_volume" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:25 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[22427c05-50e5-4ff1-a65d-e0f51f0a4193]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4661a72d-b2a7-4bba-844a-d08f707a24c3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:26 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4661a72d-b2a7-4bba-844a-d08f707a24c3 Jul 06 20:58:26 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:26 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4661a72d-b2a7-4bba-844a-d08f707a24c3" returned: 0 in 0.870s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4661a72d-b2a7-4bba-844a-d08f707a24c3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:26 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4661a72d-b2a7-4bba-844a-d08f707a24c3 Jul 06 20:58:26 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:27 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4661a72d-b2a7-4bba-844a-d08f707a24c3" returned: 0 in 0.753s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] Lock "cinder-quobyte-4661a72d-b2a7-4bba-844a-d08f707a24c3" released by "delete_volume" :: held 1.674s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:27 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] Created reservations ['7fa071bf-5c28-4985-b15b-3973e4fb62ff', 'bbb103da-0cda-4e32-9376-3e1cbc29eb01', '47f4db72-112f-41b4-9daa-b293f9959ee9', '3e67398a-1eed-4f41-9f0b-b5d344142d78'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:58:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:27 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:27 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:27 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:58:27 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:28 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.782s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:28 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:58:28 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] Deleted volume successfully. Jul 06 20:58:28 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-63e10b09-7d0b-4c1d-be9f-50a895c97d2b tempest-VolumesTransfersV357Test-946460746 None] Lock "cinder-4661a72d-b2a7-4bba-844a-d08f707a24c3-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Flow 'volume_create_manager' (7e955b41-e618-4e27-baa7-466812414918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d2d51d-30b7-4f41-866f-30cf27e53074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d2d51d-30b7-4f41-866f-30cf27e53074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1840925629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=119843a5-4029-432f-9d07-7a49329ed7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f7fff02cba4db78914cfa970474b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:33Z,use_quota=True,user_id='5c81ca6c7d4140e2858f51f2c8f2c13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2382a164-9a74-4cee-891e-fbd6e27b85ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2382a164-9a74-4cee-891e-fbd6e27b85ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe670da8-318d-4514-b207-348d1d0a97c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe670da8-318d-4514-b207-348d1d0a97c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '119843a5-4029-432f-9d07-7a49329ed7c7', 'volume_name': 'volume-119843a5-4029-432f-9d07-7a49329ed7c7', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27403ad6-2ec2-4dd6-97f3-d3f9e90959e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27403ad6-2ec2-4dd6-97f3-d3f9e90959e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced0c0fa-f68e-4040-b8d6-e52e5a4dc0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:33 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Volume 119843a5-4029-432f-9d07-7a49329ed7c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-119843a5-4029-432f-9d07-7a49329ed7c7', 'volume_size': 1} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1840925629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=119843a5-4029-432f-9d07-7a49329ed7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f7fff02cba4db78914cfa970474b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:33Z,use_quota=True,user_id='5c81ca6c7d4140e2858f51f2c8f2c13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Creating volume 119843a5-4029-432f-9d07-7a49329ed7c7 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:58:33 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:58:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:33 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7 1073741824 Jul 06 20:58:33 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:34 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7 1073741824" returned: 0 in 0.846s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:34 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7 Jul 06 20:58:34 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Flow 'volume_create_manager' (1a18d787-8c89-4ae7-84aa-b0faa116125b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b99554-ee18-48bc-81a5-975d66b54b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b99554-ee18-48bc-81a5-975d66b54b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1375734000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f71665-1d4d-44b8-8985-77cb4b324ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eea49f6a18b48c78fce84b2de369a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:35Z,use_quota=True,user_id='9739b8f2e65d49b6ae265076144befeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d313a8a-5001-43a9-9dec-9d3fd1635380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d313a8a-5001-43a9-9dec-9d3fd1635380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6eac736-7317-43fe-a685-c2afab413343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6eac736-7317-43fe-a685-c2afab413343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1f71665-1d4d-44b8-8985-77cb4b324ef2', 'volume_name': 'volume-a1f71665-1d4d-44b8-8985-77cb4b324ef2', 'volume_size': 2}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b57beba-f588-4fe7-96b9-56212e9894eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b57beba-f588-4fe7-96b9-56212e9894eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4971ed3b-5740-4eed-b541-6a920623ef02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:34 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Volume a1f71665-1d4d-44b8-8985-77cb4b324ef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1f71665-1d4d-44b8-8985-77cb4b324ef2', 'volume_size': 2} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:34 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7" returned: 0 in 0.642s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.116s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1375734000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f71665-1d4d-44b8-8985-77cb4b324ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eea49f6a18b48c78fce84b2de369a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:35Z,use_quota=True,user_id='9739b8f2e65d49b6ae265076144befeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Creating volume a1f71665-1d4d-44b8-8985-77cb4b324ef2 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:58:34 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f71665-1d4d-44b8-8985-77cb4b324ef2 2147483648 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:34 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f71665-1d4d-44b8-8985-77cb4b324ef2 2147483648 Jul 06 20:58:34 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced0c0fa-f68e-4040-b8d6-e52e5a4dc0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-119843a5-4029-432f-9d07-7a49329ed7c7', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:34 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e538676c-9298-48ce-8a75-a36d464aeedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:35 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Volume volume-119843a5-4029-432f-9d07-7a49329ed7c7 (119843a5-4029-432f-9d07-7a49329ed7c7): created successfully Jul 06 20:58:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e538676c-9298-48ce-8a75-a36d464aeedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Flow 'volume_create_manager' (7e955b41-e618-4e27-baa7-466812414918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:35 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-a2e83382-2707-4d06-bd0b-0b4403598b72 tempest-VolumesSnapshotTestJSON-976358095 None] Created volume successfully. Jul 06 20:58:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:35 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f71665-1d4d-44b8-8985-77cb4b324ef2 2147483648" returned: 0 in 0.981s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f71665-1d4d-44b8-8985-77cb4b324ef2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:36 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f71665-1d4d-44b8-8985-77cb4b324ef2 Jul 06 20:58:36 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:36 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f71665-1d4d-44b8-8985-77cb4b324ef2" returned: 0 in 0.649s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:36 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:58:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.923s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:36 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] Creating offline snapshot 42d1fad3-63fc-4be8-b7d4-07c88c204438 of volume 119843a5-4029-432f-9d07-7a49329ed7c7 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:58:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4971ed3b-5740-4eed-b541-6a920623ef02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1f71665-1d4d-44b8-8985-77cb4b324ef2', 'volume_size': 2}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83135efc-580e-40e0-9292-ce4b065d803f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:36 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2600c0-9167-4656-9724-fcc429eefbb5]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:36 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Volume volume-a1f71665-1d4d-44b8-8985-77cb4b324ef2 (a1f71665-1d4d-44b8-8985-77cb4b324ef2): created successfully Jul 06 20:58:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83135efc-580e-40e0-9292-ce4b065d803f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Flow 'volume_create_manager' (1a18d787-8c89-4ae7-84aa-b0faa116125b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:36 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-fb20864e-4f75-46be-80e3-6a9c868df2c2 tempest-VolumesCloneNegativeTest-1717159978 None] Created volume successfully. Jul 06 20:58:36 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7 Jul 06 20:58:36 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] Acquiring lock "cinder-a1f71665-1d4d-44b8-8985-77cb4b324ef2-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] Lock "cinder-a1f71665-1d4d-44b8-8985-77cb4b324ef2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:37 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] Acquiring lock "cinder-quobyte-a1f71665-1d4d-44b8-8985-77cb4b324ef2" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:37 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] Lock "cinder-quobyte-a1f71665-1d4d-44b8-8985-77cb4b324ef2" acquired by "delete_volume" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:37 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd1680a-0826-40af-875c-c636026241c7]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f71665-1d4d-44b8-8985-77cb4b324ef2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:37 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f71665-1d4d-44b8-8985-77cb4b324ef2 Jul 06 20:58:37 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:37 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7" returned: 0 in 0.788s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:37 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438 1G Jul 06 20:58:37 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:37 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f71665-1d4d-44b8-8985-77cb4b324ef2" returned: 0 in 0.824s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f71665-1d4d-44b8-8985-77cb4b324ef2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:37 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f71665-1d4d-44b8-8985-77cb4b324ef2 Jul 06 20:58:37 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:38 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438 1G" returned: 0 in 0.912s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-119843a5-4029-432f-9d07-7a49329ed7c7 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:38 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-119843a5-4029-432f-9d07-7a49329ed7c7 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438 Jul 06 20:58:38 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:38 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f71665-1d4d-44b8-8985-77cb4b324ef2" returned: 0 in 0.665s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] Lock "cinder-quobyte-a1f71665-1d4d-44b8-8985-77cb4b324ef2" released by "delete_volume" :: held 1.541s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:38 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] Created reservations ['9ad060a9-9666-459e-b7fe-84259aa4d483', 'd387d083-6de9-4818-90a9-2ead3866a518', '7279bee4-eaef-484c-8157-a77749d2b0de', '248c84e2-291a-4f64-b9cc-dfdb0aaad4c0'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:58:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:38 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:58:38 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:39 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-119843a5-4029-432f-9d07-7a49329ed7c7 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438" returned: 0 in 0.716s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:39 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438 is being set with open permissions: ugo+rw Jul 06 20:58:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:39 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438 Jul 06 20:58:39 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:39 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.652s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:39 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:58:39 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] Deleted volume successfully. Jul 06 20:58:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-fe87f56b-e4e3-4386-b2a2-8107a77cc542 tempest-VolumesCloneNegativeTest-1717159978 None] Lock "cinder-a1f71665-1d4d-44b8-8985-77cb4b324ef2-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:39 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438" returned: 0 in 0.680s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:39 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.info Jul 06 20:58:39 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:40 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.info" returned: 0 in 0.699s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:40 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.info is being set with open permissions: ugo+rw Jul 06 20:58:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:40 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.info Jul 06 20:58:40 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:41 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.info" returned: 0 in 0.656s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.557s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:41 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-ae012488-c199-44ee-9de6-69909ca21889 tempest-VolumesSnapshotTestJSON-976358095 None] Create snapshot completed successfully Jul 06 20:58:41 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:58:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Flow 'volume_create_manager' (75882007-4edf-4623-83d1-0b5f0e1dbd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcb0d63-9525-4ae7-b0c3-6a410b7f5f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcb0d63-9525-4ae7-b0c3-6a410b7f5f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1748176183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2b49f9-03c7-4c25-8887-86430a0a9b5d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d7f1fe3442254bdc86d077b189c767b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:42Z,use_quota=True,user_id='70bbaccbbe294764b5e564cf79ca2a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (997286b8-0f5c-402d-b721-cb6c82ec0748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (997286b8-0f5c-402d-b721-cb6c82ec0748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58378762-fe1b-474f-b8b3-27961c25ee69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58378762-fe1b-474f-b8b3-27961c25ee69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2b49f9-03c7-4c25-8887-86430a0a9b5d', 'volume_name': 'volume-8b2b49f9-03c7-4c25-8887-86430a0a9b5d', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5721caf0-7733-4f79-ac2d-5fa1b3944388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5721caf0-7733-4f79-ac2d-5fa1b3944388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c2706a5-b1df-4abe-b005-f3c554433961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:42 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Volume 8b2b49f9-03c7-4c25-8887-86430a0a9b5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2b49f9-03c7-4c25-8887-86430a0a9b5d', 'volume_size': 1} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1748176183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2b49f9-03c7-4c25-8887-86430a0a9b5d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d7f1fe3442254bdc86d077b189c767b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:42Z,use_quota=True,user_id='70bbaccbbe294764b5e564cf79ca2a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Creating volume 8b2b49f9-03c7-4c25-8887-86430a0a9b5d {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:58:42 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b2b49f9-03c7-4c25-8887-86430a0a9b5d 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:42 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b2b49f9-03c7-4c25-8887-86430a0a9b5d 1073741824 Jul 06 20:58:42 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-42d1fad3-63fc-4be8-b7d4-07c88c204438-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-42d1fad3-63fc-4be8-b7d4-07c88c204438-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-quobyte-119843a5-4029-432f-9d07-7a49329ed7c7" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-119843a5-4029-432f-9d07-7a49329ed7c7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-quobyte-42d1fad3-63fc-4be8-b7d4-07c88c204438" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-42d1fad3-63fc-4be8-b7d4-07c88c204438" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] Deleting offline snapshot 42d1fad3-63fc-4be8-b7d4-07c88c204438 of volume 119843a5-4029-432f-9d07-7a49329ed7c7 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] snapshot_file for this snap is: volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2facb2-b770-4e7a-95e7-6b28de7c9301]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:42 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438 Jul 06 20:58:42 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:42 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b2b49f9-03c7-4c25-8887-86430a0a9b5d 1073741824" returned: 0 in 0.905s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b2b49f9-03c7-4c25-8887-86430a0a9b5d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:43 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b2b49f9-03c7-4c25-8887-86430a0a9b5d Jul 06 20:58:43 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:43 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438" returned: 0 in 0.791s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-119843a5-4029-432f-9d07-7a49329ed7c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:58:43 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7d3971-9ef2-4604-9680-2106da3783a6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:43 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7 Jul 06 20:58:43 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:43 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b2b49f9-03c7-4c25-8887-86430a0a9b5d" returned: 0 in 0.641s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:58:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c2706a5-b1df-4abe-b005-f3c554433961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2b49f9-03c7-4c25-8887-86430a0a9b5d', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42fd06c-9102-49ba-991d-5ffc6b9777f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:43 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Volume volume-8b2b49f9-03c7-4c25-8887-86430a0a9b5d (8b2b49f9-03c7-4c25-8887-86430a0a9b5d): created successfully Jul 06 20:58:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42fd06c-9102-49ba-991d-5ffc6b9777f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Flow 'volume_create_manager' (75882007-4edf-4623-83d1-0b5f0e1dbd94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:43 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-632dbbf7-b23e-400f-af61-afc110191a1e tempest-VolumesListTestJSON-1416174959 None] Created volume successfully. Jul 06 20:58:43 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7" returned: 0 in 0.793s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:43 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438 Jul 06 20:58:43 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Flow 'volume_create_manager' (114870a7-5923-4753-b39b-e92c2fcfb146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9b0c7a-8fef-476b-ae4e-cc2c5cc372bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9b0c7a-8fef-476b-ae4e-cc2c5cc372bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1097920107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c539f90-9781-461d-8971-175bda6a4863,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d7f1fe3442254bdc86d077b189c767b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:44Z,use_quota=True,user_id='70bbaccbbe294764b5e564cf79ca2a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632effbb-e6d1-487f-87cb-a06a8cfcf208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632effbb-e6d1-487f-87cb-a06a8cfcf208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d269a96-6da7-4147-9020-e7c21a1c088a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d269a96-6da7-4147-9020-e7c21a1c088a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c539f90-9781-461d-8971-175bda6a4863', 'volume_name': 'volume-0c539f90-9781-461d-8971-175bda6a4863', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db95656-415f-4e8c-a6d8-f10c102d00a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db95656-415f-4e8c-a6d8-f10c102d00a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5cf6173-b545-42b7-a4f8-24a41e747991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:44 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Volume 0c539f90-9781-461d-8971-175bda6a4863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c539f90-9781-461d-8971-175bda6a4863', 'volume_size': 1} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1097920107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c539f90-9781-461d-8971-175bda6a4863,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d7f1fe3442254bdc86d077b189c767b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:44Z,use_quota=True,user_id='70bbaccbbe294764b5e564cf79ca2a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Creating volume 0c539f90-9781-461d-8971-175bda6a4863 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:44 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:58:44 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0c539f90-9781-461d-8971-175bda6a4863 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438" returned: 0 in 0.766s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:44 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0c539f90-9781-461d-8971-175bda6a4863 1073741824 Jul 06 20:58:44 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:44 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438 Jul 06 20:58:44 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:45 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7.42d1fad3-63fc-4be8-b7d4-07c88c204438" returned: 0 in 0.644s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:45 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:UPDATE=157,cinder:SELECT=118,cinder:DELETE=10,cinder:INSERT=29 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:58:45 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=112,cinder:INSERT=47,cinder:UPDATE=169,cinder:DELETE=20 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:58:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-42d1fad3-63fc-4be8-b7d4-07c88c204438" released by "_delete_snapshot" :: held 3.120s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-119843a5-4029-432f-9d07-7a49329ed7c7" released by "delete_snapshot" :: held 3.153s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:45 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] Created reservations ['a746acd0-66d3-4aab-af9a-c4afd5565d2a', '11a73afc-69fb-4171-892b-c06f3f0388be', 'd0fd5df1-7735-43a3-adf1-2c48ae7336e0', '5f635047-80a4-4824-a020-e9473554f221'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:58:45 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] Delete snapshot completed successfully. Jul 06 20:58:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-91b83fd8-7754-404a-98d9-f06931b59d15 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-42d1fad3-63fc-4be8-b7d4-07c88c204438-delete_snapshot" released by "delete_snapshot" :: held 3.366s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:45 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0c539f90-9781-461d-8971-175bda6a4863 1073741824" returned: 0 in 0.884s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0c539f90-9781-461d-8971-175bda6a4863 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:45 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0c539f90-9781-461d-8971-175bda6a4863 Jul 06 20:58:45 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:46 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0c539f90-9781-461d-8971-175bda6a4863" returned: 0 in 0.640s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5cf6173-b545-42b7-a4f8-24a41e747991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c539f90-9781-461d-8971-175bda6a4863', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8f1846-3c06-4104-91d3-6db5a2b7083e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:46 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Volume volume-0c539f90-9781-461d-8971-175bda6a4863 (0c539f90-9781-461d-8971-175bda6a4863): created successfully Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8f1846-3c06-4104-91d3-6db5a2b7083e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Flow 'volume_create_manager' (114870a7-5923-4753-b39b-e92c2fcfb146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:46 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e076f1a0-f1e4-4e3a-bb2c-02d0e7075b4c tempest-VolumesListTestJSON-1416174959 None] Created volume successfully. Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Flow 'volume_create_manager' (5dcf1c1c-e06e-45e3-bc88-42173999fb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e73d8e64-4c6d-42d3-acd1-7bdf15952052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e73d8e64-4c6d-42d3-acd1-7bdf15952052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1423936143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f6160e-3a80-46b0-897a-f1f9943b3afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f7fff02cba4db78914cfa970474b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:47Z,use_quota=True,user_id='5c81ca6c7d4140e2858f51f2c8f2c13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35078f4-5d82-4a1a-8a3e-64efc57439c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35078f4-5d82-4a1a-8a3e-64efc57439c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3855a2-d2e3-4141-ba4a-d6702513621f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3855a2-d2e3-4141-ba4a-d6702513621f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1f6160e-3a80-46b0-897a-f1f9943b3afa', 'volume_name': 'volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23dd48f-0430-4191-babd-3b70054d9d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23dd48f-0430-4191-babd-3b70054d9d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8865bd10-9116-47ab-aecf-34370ceade6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:46 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Volume a1f6160e-3a80-46b0-897a-f1f9943b3afa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa', 'volume_size': 1} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1423936143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f6160e-3a80-46b0-897a-f1f9943b3afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f7fff02cba4db78914cfa970474b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:47Z,use_quota=True,user_id='5c81ca6c7d4140e2858f51f2c8f2c13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Creating volume a1f6160e-3a80-46b0-897a-f1f9943b3afa {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:58:46 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:58:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:46 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa 1073741824 Jul 06 20:58:46 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:47 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:58:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Flow 'volume_create_manager' (b7b3da7d-0366-4dbc-9186-2962c627add3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8494f60-826b-407a-b5fb-9aa04f29fda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8494f60-826b-407a-b5fb-9aa04f29fda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1769123285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa75a5e6-0188-4560-adfe-b083118757ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d7f1fe3442254bdc86d077b189c767b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:47Z,use_quota=True,user_id='70bbaccbbe294764b5e564cf79ca2a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d921bcfb-2e6b-494e-bfe0-663990383ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d921bcfb-2e6b-494e-bfe0-663990383ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b2ba88-297a-4d95-8114-5339e9dd3695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b2ba88-297a-4d95-8114-5339e9dd3695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa75a5e6-0188-4560-adfe-b083118757ce', 'volume_name': 'volume-fa75a5e6-0188-4560-adfe-b083118757ce', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e1cb4d-21d0-4d6f-9d4b-bc60ce72ad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e1cb4d-21d0-4d6f-9d4b-bc60ce72ad3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf17f434-89d9-4a2a-93b4-74a7687467eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:47 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Volume fa75a5e6-0188-4560-adfe-b083118757ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa75a5e6-0188-4560-adfe-b083118757ce', 'volume_size': 1} Jul 06 20:58:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:47 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa 1073741824" returned: 0 in 0.809s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:47 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa Jul 06 20:58:47 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:48 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa" returned: 0 in 0.614s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:58:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.127s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1769123285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa75a5e6-0188-4560-adfe-b083118757ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d7f1fe3442254bdc86d077b189c767b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:47Z,use_quota=True,user_id='70bbaccbbe294764b5e564cf79ca2a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:58:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Creating volume fa75a5e6-0188-4560-adfe-b083118757ce {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:58:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:58:48 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:58:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fa75a5e6-0188-4560-adfe-b083118757ce 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8865bd10-9116-47ab-aecf-34370ceade6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:48 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fa75a5e6-0188-4560-adfe-b083118757ce 1073741824 Jul 06 20:58:48 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b4724e-8af0-46b7-b8f7-86586c4480a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:48 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Volume volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa (a1f6160e-3a80-46b0-897a-f1f9943b3afa): created successfully Jul 06 20:58:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b4724e-8af0-46b7-b8f7-86586c4480a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Flow 'volume_create_manager' (5dcf1c1c-e06e-45e3-bc88-42173999fb6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:48 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-a964066d-fd4d-4960-84f0-47fc19938d31 tempest-VolumesSnapshotTestJSON-976358095 None] Created volume successfully. Jul 06 20:58:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:49 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fa75a5e6-0188-4560-adfe-b083118757ce 1073741824" returned: 0 in 0.836s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fa75a5e6-0188-4560-adfe-b083118757ce {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:49 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fa75a5e6-0188-4560-adfe-b083118757ce Jul 06 20:58:49 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:49 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fa75a5e6-0188-4560-adfe-b083118757ce" returned: 0 in 0.616s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:58:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.797s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] Creating offline snapshot 760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 of volume a1f6160e-3a80-46b0-897a-f1f9943b3afa {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:58:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf17f434-89d9-4a2a-93b4-74a7687467eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa75a5e6-0188-4560-adfe-b083118757ce', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda55df1-9f47-4e20-b65b-75c7f7d441ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:49 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5121442b-5aa8-4f3a-a676-ed19db153de4]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:49 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Volume volume-fa75a5e6-0188-4560-adfe-b083118757ce (fa75a5e6-0188-4560-adfe-b083118757ce): created successfully Jul 06 20:58:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda55df1-9f47-4e20-b65b-75c7f7d441ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Flow 'volume_create_manager' (b7b3da7d-0366-4dbc-9186-2962c627add3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:49 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9b8ed6d9-93d4-46b3-8f38-8d2ec0079934 tempest-VolumesListTestJSON-1416174959 None] Created volume successfully. Jul 06 20:58:50 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa Jul 06 20:58:50 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:50 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa" returned: 0 in 0.786s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:50 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 1G Jul 06 20:58:50 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:51 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 1G" returned: 0 in 0.819s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:51 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 Jul 06 20:58:51 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:52 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7" returned: 0 in 0.721s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:52 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 is being set with open permissions: ugo+rw Jul 06 20:58:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:52 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 Jul 06 20:58:52 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] Acquiring lock "cinder-fa75a5e6-0188-4560-adfe-b083118757ce-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] Lock "cinder-fa75a5e6-0188-4560-adfe-b083118757ce-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] Acquiring lock "cinder-quobyte-fa75a5e6-0188-4560-adfe-b083118757ce" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] Lock "cinder-quobyte-fa75a5e6-0188-4560-adfe-b083118757ce" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:52 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08e79fd-f5ea-4d53-ba3d-52fd6d6e379c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fa75a5e6-0188-4560-adfe-b083118757ce {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:52 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fa75a5e6-0188-4560-adfe-b083118757ce Jul 06 20:58:52 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:52 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7" returned: 0 in 0.651s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:52 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.info Jul 06 20:58:52 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:53 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fa75a5e6-0188-4560-adfe-b083118757ce" returned: 0 in 0.736s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fa75a5e6-0188-4560-adfe-b083118757ce {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:53 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fa75a5e6-0188-4560-adfe-b083118757ce Jul 06 20:58:53 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:53 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.info" returned: 0 in 0.633s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:53 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.info is being set with open permissions: ugo+rw Jul 06 20:58:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:53 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.info Jul 06 20:58:53 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:53 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fa75a5e6-0188-4560-adfe-b083118757ce" returned: 0 in 0.618s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:53 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] Lock "cinder-quobyte-fa75a5e6-0188-4560-adfe-b083118757ce" released by "delete_volume" :: held 1.401s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:53 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] Created reservations ['0a25720d-df0a-4917-b0e3-d1a6d6d31434', '631d6e57-5185-41b5-ba37-b26e346017d9', '6d41a1ed-7dba-4661-a30a-94779a46421e', '1e3b8189-5c2b-403f-ac81-3974c772dfff'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:58:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:53 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:58:53 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:54 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.info" returned: 0 in 0.621s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.322s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:54 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-fedd63ce-0c40-456b-ba1c-916abc7d77f0 tempest-VolumesSnapshotTestJSON-976358095 None] Create snapshot completed successfully Jul 06 20:58:54 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.645s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:54 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:58:54 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] Deleted volume successfully. Jul 06 20:58:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d8333da5-0b79-4204-95e9-8b39bebabfd4 tempest-VolumesListTestJSON-1416174959 None] Lock "cinder-fa75a5e6-0188-4560-adfe-b083118757ce-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] Acquiring lock "cinder-0c539f90-9781-461d-8971-175bda6a4863-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] Lock "cinder-0c539f90-9781-461d-8971-175bda6a4863-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] Acquiring lock "cinder-quobyte-0c539f90-9781-461d-8971-175bda6a4863" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] Lock "cinder-quobyte-0c539f90-9781-461d-8971-175bda6a4863" acquired by "delete_volume" :: waited 0.013s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:54 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[757e41a1-c3f2-4002-a199-c5c2de47ad51]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0c539f90-9781-461d-8971-175bda6a4863 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:54 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0c539f90-9781-461d-8971-175bda6a4863 Jul 06 20:58:54 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:55 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0c539f90-9781-461d-8971-175bda6a4863" returned: 0 in 0.730s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0c539f90-9781-461d-8971-175bda6a4863 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:55 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0c539f90-9781-461d-8971-175bda6a4863 Jul 06 20:58:55 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Flow 'volume_create_manager' (efda34f6-a908-401d-ae5b-b536bf203b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d944e659-3eea-49cc-8b19-cab485c88635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d944e659-3eea-49cc-8b19-cab485c88635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-997235411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add774d5-829b-45fa-94fa-15d3ac49e6c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f7fff02cba4db78914cfa970474b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=760c2c3c-a253-4826-a4fe-06bcc4d9e6f7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:56Z,use_quota=True,user_id='5c81ca6c7d4140e2858f51f2c8f2c13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ebd3e2d-30da-4e60-8425-c6951deb4c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ebd3e2d-30da-4e60-8425-c6951deb4c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55479420-8c7d-44bb-aad3-e48796c18f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55479420-8c7d-44bb-aad3-e48796c18f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'add774d5-829b-45fa-94fa-15d3ac49e6c7', 'volume_name': 'volume-add774d5-829b-45fa-94fa-15d3ac49e6c7', 'volume_size': 2, 'snapshot_id': '760c2c3c-a253-4826-a4fe-06bcc4d9e6f7'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45fc5ffc-4010-4902-9cfb-ff123d84871e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45fc5ffc-4010-4902-9cfb-ff123d84871e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995443c4-ec14-4323-a8b7-a4483ea404fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:58:55 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Volume add774d5-829b-45fa-94fa-15d3ac49e6c7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-add774d5-829b-45fa-94fa-15d3ac49e6c7', 'volume_size': 2, 'snapshot_id': '760c2c3c-a253-4826-a4fe-06bcc4d9e6f7'} Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-quobyte-760c2c3c-a253-4826-a4fe-06bcc4d9e6f7-add774d5-829b-45fa-94fa-15d3ac49e6c7" by "_create_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-760c2c3c-a253-4826-a4fe-06bcc4d9e6f7-add774d5-829b-45fa-94fa-15d3ac49e6c7" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Creating volume add774d5-829b-45fa-94fa-15d3ac49e6c7 from snapshot 760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 {{(pid=87207) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 20:58:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-quobyte-add774d5-829b-45fa-94fa-15d3ac49e6c7" by "_copy_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-add774d5-829b-45fa-94fa-15d3ac49e6c7" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] snapshot: 760c2c3c-a253-4826-a4fe-06bcc4d9e6f7, volume: add774d5-829b-45fa-94fa-15d3ac49e6c7, {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f92287f-5138-4d05-a821-e88bc3e5044b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:56 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0c539f90-9781-461d-8971-175bda6a4863" returned: 0 in 0.660s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] Lock "cinder-quobyte-0c539f90-9781-461d-8971-175bda6a4863" released by "delete_volume" :: held 1.429s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] Created reservations ['b3a41be2-a6d7-4f08-b0cb-9e9781ee7354', '9f570e8f-453f-4205-b5b2-07bd2ead4683', '6dc000cb-54d8-4e61-8e4c-ff9628e0add1', 'dffb261a-af89-4f5c-9092-f5f74aded4af'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:58:56 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 Jul 06 20:58:56 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:56 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:58:56 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:56 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7" returned: 0 in 0.809s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Creating direct copy from snapshot {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e65d6f-623c-415a-a400-591c9f1afa37]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:56 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.674s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] Acquiring lock "cinder-8b2b49f9-03c7-4c25-8887-86430a0a9b5d-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:56 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] Deleted volume successfully. Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] Lock "cinder-8b2b49f9-03c7-4c25-8887-86430a0a9b5d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6ca88365-1b49-4f54-a65c-a3e5409e2d83 tempest-VolumesListTestJSON-1416174959 None] Lock "cinder-0c539f90-9781-461d-8971-175bda6a4863-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] Acquiring lock "cinder-quobyte-8b2b49f9-03c7-4c25-8887-86430a0a9b5d" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:58:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] Lock "cinder-quobyte-8b2b49f9-03c7-4c25-8887-86430a0a9b5d" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:58:57 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa Jul 06 20:58:57 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:57 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa32e6fb-6e8c-4121-af77-ca0495eed585]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:58:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b2b49f9-03c7-4c25-8887-86430a0a9b5d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:57 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b2b49f9-03c7-4c25-8887-86430a0a9b5d Jul 06 20:58:57 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:57 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa" returned: 0 in 0.752s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:57 devstack cinder-volume[87207]: DEBUG cinder.utils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Path /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-add774d5-829b-45fa-94fa-15d3ac49e6c7 not found in is_blk_device check {{(pid=87207) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 20:58:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-add774d5-829b-45fa-94fa-15d3ac49e6c7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:57 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-add774d5-829b-45fa-94fa-15d3ac49e6c7 Jul 06 20:58:57 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:57 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b2b49f9-03c7-4c25-8887-86430a0a9b5d" returned: 0 in 0.756s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b2b49f9-03c7-4c25-8887-86430a0a9b5d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:57 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b2b49f9-03c7-4c25-8887-86430a0a9b5d Jul 06 20:58:57 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:58:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:58 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:58:58 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:58 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-8b2b49f9-03c7-4c25-8887-86430a0a9b5d" returned: 0 in 0.660s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] Lock "cinder-quobyte-8b2b49f9-03c7-4c25-8887-86430a0a9b5d" released by "delete_volume" :: held 1.471s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:58:58 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] Created reservations ['681ee6a3-37d1-4b8a-bd82-c28937603b0d', '292f96fb-b97d-4e3a-a077-94e85ef3ffb1', 'a7aecc01-65e4-4c9e-9f14-6a56fbe55407', '24c0dcb2-8b5f-497d-89df-d36bd348ca74'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:58:58 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.943s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:58:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:58:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:58:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:58:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:58:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:58:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:59 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:58:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:58:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:58:59 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:58:59 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:00 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.693s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:00 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:59:00 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] Deleted volume successfully. Jul 06 20:59:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-66cf2081-4595-412b-9cab-4927e4a04a18 tempest-VolumesListTestJSON-1416174959 None] Lock "cinder-8b2b49f9-03c7-4c25-8887-86430a0a9b5d-delete_volume" released by "delete_volume" :: held 3.812s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:02 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-add774d5-829b-45fa-94fa-15d3ac49e6c7" returned: 0 in 5.223s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:02 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc88a61-defd-46f3-a801-24724cb5c0c0]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:03 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa Jul 06 20:59:03 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:03 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa" returned: 0 in 0.916s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:03 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Image conversion details: src /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-add774d5-829b-45fa-94fa-15d3ac49e6c7 {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 20:59:03 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Converted 1024.00 MB image at 196.01 MB/s Jul 06 20:59:03 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-add774d5-829b-45fa-94fa-15d3ac49e6c7 is being set with open permissions: ugo+rw Jul 06 20:59:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-add774d5-829b-45fa-94fa-15d3ac49e6c7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:03 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-add774d5-829b-45fa-94fa-15d3ac49e6c7 Jul 06 20:59:03 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:59:04 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Flow 'volume_create_manager' (946e690c-665e-4714-9748-07b32e66d798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ab009f-8317-4530-90e6-18ea8327efd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-add774d5-829b-45fa-94fa-15d3ac49e6c7" returned: 0 in 0.642s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ab009f-8317-4530-90e6-18ea8327efd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1814284568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b520e17-698e-4378-b9c8-937a2bcb8cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49c0c1e2821420495b55a7170d06bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:59:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:59:04Z,use_quota=True,user_id='9dd71db19b5d4831b47d8be16d76321f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541a8036-0e21-49c8-ab0d-de7f6ca669d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541a8036-0e21-49c8-ab0d-de7f6ca669d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9cb48d-3384-473b-a6aa-8f0bb9aa1b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9cb48d-3384-473b-a6aa-8f0bb9aa1b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b520e17-698e-4378-b9c8-937a2bcb8cfa', 'volume_name': 'volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa', 'volume_size': 2}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05fb4d5c-c3ec-4da4-83c2-cde1c5bf1328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05fb4d5c-c3ec-4da4-83c2-cde1c5bf1328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a860acc-3822-4816-832d-81a90e8142f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:04 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Volume 4b520e17-698e-4378-b9c8-937a2bcb8cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa', 'volume_size': 2} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-add774d5-829b-45fa-94fa-15d3ac49e6c7" released by "_copy_volume_from_snapshot" :: held 8.476s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-760c2c3c-a253-4826-a4fe-06bcc4d9e6f7-add774d5-829b-45fa-94fa-15d3ac49e6c7" released by "_create_volume_from_snapshot" :: held 8.507s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.524s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1814284568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b520e17-698e-4378-b9c8-937a2bcb8cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49c0c1e2821420495b55a7170d06bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:59:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:59:04Z,use_quota=True,user_id='9dd71db19b5d4831b47d8be16d76321f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Creating volume 4b520e17-698e-4378-b9c8-937a2bcb8cfa {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:59:04 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa 2147483648 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:04 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa 2147483648 Jul 06 20:59:04 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995443c4-ec14-4323-a8b7-a4483ea404fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add774d5-829b-45fa-94fa-15d3ac49e6c7', 'volume_size': 2, 'snapshot_id': '760c2c3c-a253-4826-a4fe-06bcc4d9e6f7'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9d17da-596c-4a02-a534-b01de4dac857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:04 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Volume volume-add774d5-829b-45fa-94fa-15d3ac49e6c7 (add774d5-829b-45fa-94fa-15d3ac49e6c7): created successfully Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9d17da-596c-4a02-a534-b01de4dac857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Flow 'volume_create_manager' (efda34f6-a908-401d-ae5b-b536bf203b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:59:04 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-25d96d77-6423-4caa-98ca-d0f59d1e10e2 tempest-VolumesSnapshotTestJSON-976358095 None] Created volume successfully. Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-add774d5-829b-45fa-94fa-15d3ac49e6c7-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-add774d5-829b-45fa-94fa-15d3ac49e6c7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-quobyte-add774d5-829b-45fa-94fa-15d3ac49e6c7" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-add774d5-829b-45fa-94fa-15d3ac49e6c7" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9858a7e5-037d-4214-ad82-df6a5511f473]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-add774d5-829b-45fa-94fa-15d3ac49e6c7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:04 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-add774d5-829b-45fa-94fa-15d3ac49e6c7 Jul 06 20:59:04 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:05 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa 2147483648" returned: 0 in 0.843s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:05 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa Jul 06 20:59:05 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:05 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-add774d5-829b-45fa-94fa-15d3ac49e6c7" returned: 0 in 0.753s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-add774d5-829b-45fa-94fa-15d3ac49e6c7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:05 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-add774d5-829b-45fa-94fa-15d3ac49e6c7 Jul 06 20:59:05 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:06 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa" returned: 0 in 0.639s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a860acc-3822-4816-832d-81a90e8142f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa', 'volume_size': 2}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd28a436-04f8-45fb-bb3e-d1b0a53a4933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:06 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Volume volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa (4b520e17-698e-4378-b9c8-937a2bcb8cfa): created successfully Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd28a436-04f8-45fb-bb3e-d1b0a53a4933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Flow 'volume_create_manager' (946e690c-665e-4714-9748-07b32e66d798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:59:06 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-685ce0b1-2a58-4e0f-b30e-5228add14d15 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Created volume successfully. Jul 06 20:59:06 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-add774d5-829b-45fa-94fa-15d3ac49e6c7" returned: 0 in 0.618s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-add774d5-829b-45fa-94fa-15d3ac49e6c7" released by "delete_volume" :: held 1.414s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] Created reservations ['4b096c02-f98a-4b05-b068-fe5ea986ff93', '208bff49-dd33-4be0-b08c-c78e8dc62e74', '11397bfa-be11-4861-8dab-03403eb072d8', 'f8a9de37-f782-4e13-be98-2ac26d186648'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:06 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:59:06 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Creating offline snapshot c4f00865-a859-48bb-8066-b5ce98956599 of volume 4b520e17-698e-4378-b9c8-937a2bcb8cfa {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f45b5f9-683b-44ee-a7ff-4e34d26309b2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:06 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa Jul 06 20:59:06 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:06 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.643s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:06 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:59:07 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] Deleted volume successfully. Jul 06 20:59:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d3ffbee0-9847-4665-a1da-62667da9891a tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-add774d5-829b-45fa-94fa-15d3ac49e6c7-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-760c2c3c-a253-4826-a4fe-06bcc4d9e6f7-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-760c2c3c-a253-4826-a4fe-06bcc4d9e6f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-quobyte-a1f6160e-3a80-46b0-897a-f1f9943b3afa" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-a1f6160e-3a80-46b0-897a-f1f9943b3afa" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-quobyte-760c2c3c-a253-4826-a4fe-06bcc4d9e6f7" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-760c2c3c-a253-4826-a4fe-06bcc4d9e6f7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] Deleting offline snapshot 760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 of volume a1f6160e-3a80-46b0-897a-f1f9943b3afa {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:59:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] snapshot_file for this snap is: volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:59:07 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7b5ec1-b5ec-4bfc-9a15-424f0a11df31]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:07 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 Jul 06 20:59:07 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:07 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa" returned: 0 in 0.807s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599 2G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:07 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599 2G Jul 06 20:59:07 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:07 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7" returned: 0 in 0.769s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:59:07 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[50528214-a42d-4d82-840a-ca485398e1c2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:08 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa Jul 06 20:59:08 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:08 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599 2G" returned: 0 in 0.800s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:08 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599 Jul 06 20:59:08 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:08 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa" returned: 0 in 0.765s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:08 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 Jul 06 20:59:08 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:09 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599" returned: 0 in 0.695s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:09 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599 is being set with open permissions: ugo+rw Jul 06 20:59:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:09 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599 Jul 06 20:59:09 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:09 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7" returned: 0 in 0.698s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:09 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7 Jul 06 20:59:09 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:09 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599" returned: 0 in 0.635s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:09 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.info Jul 06 20:59:09 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:10 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa.760c2c3c-a253-4826-a4fe-06bcc4d9e6f7" returned: 0 in 0.649s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-760c2c3c-a253-4826-a4fe-06bcc4d9e6f7" released by "_delete_snapshot" :: held 2.979s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-a1f6160e-3a80-46b0-897a-f1f9943b3afa" released by "delete_snapshot" :: held 3.001s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:10 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] Created reservations ['6489f148-8c6a-49a2-a692-a26b17320e6e', '39f9089c-5f36-4318-a1c4-655708120e8e', '2ed58434-0f9c-4953-8976-929f68a80b9b', '736d0b4f-db88-4f31-bd75-0cd45eab3d52'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:59:10 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] Delete snapshot completed successfully. Jul 06 20:59:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-9a36b2fd-ce2e-4354-81e6-b7445e3bd80d tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-760c2c3c-a253-4826-a4fe-06bcc4d9e6f7-delete_snapshot" released by "delete_snapshot" :: held 3.165s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:10 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.info" returned: 0 in 0.640s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:10 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.info is being set with open permissions: ugo+rw Jul 06 20:59:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:10 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.info Jul 06 20:59:10 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:10 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.info" returned: 0 in 0.631s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.302s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:10 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-68eae699-8980-468a-8dc2-2db31b5ed915 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Create snapshot completed successfully Jul 06 20:59:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-a1f6160e-3a80-46b0-897a-f1f9943b3afa-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-a1f6160e-3a80-46b0-897a-f1f9943b3afa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-quobyte-a1f6160e-3a80-46b0-897a-f1f9943b3afa" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-a1f6160e-3a80-46b0-897a-f1f9943b3afa" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:11 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[535a6826-4bcf-43ec-853c-fc1833f45f39]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:11 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa Jul 06 20:59:11 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Acquiring lock "cinder-c4f00865-a859-48bb-8066-b5ce98956599-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Lock "cinder-c4f00865-a859-48bb-8066-b5ce98956599-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Acquiring lock "cinder-quobyte-4b520e17-698e-4378-b9c8-937a2bcb8cfa" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Lock "cinder-quobyte-4b520e17-698e-4378-b9c8-937a2bcb8cfa" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Acquiring lock "cinder-quobyte-c4f00865-a859-48bb-8066-b5ce98956599" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Lock "cinder-quobyte-c4f00865-a859-48bb-8066-b5ce98956599" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Deleting offline snapshot c4f00865-a859-48bb-8066-b5ce98956599 of volume 4b520e17-698e-4378-b9c8-937a2bcb8cfa {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:59:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] snapshot_file for this snap is: volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:59:12 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[203d9113-6ec7-4156-b17b-cafc8bd87df2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:12 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599 Jul 06 20:59:12 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:12 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa" returned: 0 in 0.776s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:12 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa Jul 06 20:59:12 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:12 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599" returned: 0 in 0.757s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:59:12 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e615cfea-eaa1-4946-9d56-80fd56c31472]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:12 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a1f6160e-3a80-46b0-897a-f1f9943b3afa" returned: 0 in 0.636s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:12 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-a1f6160e-3a80-46b0-897a-f1f9943b3afa" released by "delete_volume" :: held 1.493s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:12 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa Jul 06 20:59:12 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:12 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] Created reservations ['d3f11995-fecf-4adc-bee4-ee65746f14cd', '1993979a-2ba3-43ae-a12e-4ad70d1b3290', 'a15e82ce-5cb3-4359-9b8d-91b83b18d4a1', '6c3f9221-467d-4ea6-8b42-d52c317af020'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:59:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:59:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:59:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:13 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:59:13 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:13 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa" returned: 0 in 0.723s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:13 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599 Jul 06 20:59:13 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:13 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.632s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:13 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:59:13 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] Deleted volume successfully. Jul 06 20:59:13 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b2223a6f-aa74-4f41-b4e8-8528c5663f3f tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-a1f6160e-3a80-46b0-897a-f1f9943b3afa-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:14 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Flow 'volume_create_manager' (645769d7-e1ec-4e97-9718-b26bc47c73a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de91e8c-fb10-450e-8337-83002148ba18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599" returned: 0 in 0.810s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:14 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599 Jul 06 20:59:14 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de91e8c-fb10-450e-8337-83002148ba18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-367409687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28233579-8a91-4401-9933-4679105bb46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f7fff02cba4db78914cfa970474b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:59:14Z,use_quota=True,user_id='5c81ca6c7d4140e2858f51f2c8f2c13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab816c66-360d-4151-bf34-3f6daae084ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab816c66-360d-4151-bf34-3f6daae084ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff9658f-ce82-44c1-abd3-df359e0c3870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff9658f-ce82-44c1-abd3-df359e0c3870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28233579-8a91-4401-9933-4679105bb46e', 'volume_name': 'volume-28233579-8a91-4401-9933-4679105bb46e', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4f6602-2882-426c-b302-ebfe5588b439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4f6602-2882-426c-b302-ebfe5588b439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4375e67f-fb0c-49b1-9bfb-6a9fcdc7d94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:14 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Volume 28233579-8a91-4401-9933-4679105bb46e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28233579-8a91-4401-9933-4679105bb46e', 'volume_size': 1} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-367409687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28233579-8a91-4401-9933-4679105bb46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f7fff02cba4db78914cfa970474b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:59:14Z,use_quota=True,user_id='5c81ca6c7d4140e2858f51f2c8f2c13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Creating volume 28233579-8a91-4401-9933-4679105bb46e {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:59:14 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:14 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e 1073741824 Jul 06 20:59:14 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:14 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa.c4f00865-a859-48bb-8066-b5ce98956599" returned: 0 in 0.611s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Lock "cinder-quobyte-c4f00865-a859-48bb-8066-b5ce98956599" released by "_delete_snapshot" :: held 3.017s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Lock "cinder-quobyte-4b520e17-698e-4378-b9c8-937a2bcb8cfa" released by "delete_snapshot" :: held 3.039s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:15 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Created reservations ['50ae82e1-8680-441c-97ce-9181984d986d', '815d5f4e-4ca7-42dd-98ff-602daa5c3aa3', '5061620e-2446-4214-9b49-2cc034a471ef', 'e6e7d967-9bdc-40fa-8f19-961948d2ad53'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:59:15 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Delete snapshot completed successfully. Jul 06 20:59:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e3e4b80c-3cc4-4836-87b1-8e98c54c7a5a tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Lock "cinder-c4f00865-a859-48bb-8066-b5ce98956599-delete_snapshot" released by "delete_snapshot" :: held 3.198s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:15 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e 1073741824" returned: 0 in 0.907s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:15 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e Jul 06 20:59:15 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:16 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e" returned: 0 in 0.685s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:59:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4375e67f-fb0c-49b1-9bfb-6a9fcdc7d94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28233579-8a91-4401-9933-4679105bb46e', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2345a0f-6d17-4092-8cd2-ff9d3c25025f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:16 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Volume volume-28233579-8a91-4401-9933-4679105bb46e (28233579-8a91-4401-9933-4679105bb46e): created successfully Jul 06 20:59:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2345a0f-6d17-4092-8cd2-ff9d3c25025f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Flow 'volume_create_manager' (645769d7-e1ec-4e97-9718-b26bc47c73a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:59:16 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e018f068-6ff7-42f8-8470-82cad569c2c9 tempest-VolumesSnapshotTestJSON-976358095 None] Created volume successfully. Jul 06 20:59:16 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Acquiring lock "cinder-4b520e17-698e-4378-b9c8-937a2bcb8cfa-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:16 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Lock "cinder-4b520e17-698e-4378-b9c8-937a2bcb8cfa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:16 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Acquiring lock "cinder-quobyte-4b520e17-698e-4378-b9c8-937a2bcb8cfa" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:16 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Lock "cinder-quobyte-4b520e17-698e-4378-b9c8-937a2bcb8cfa" acquired by "delete_volume" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:16 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49deee1-6b39-470f-8f56-71f533627c2e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:16 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa Jul 06 20:59:16 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] Creating offline snapshot 87dea38f-9c54-4d20-9475-782998fce248 of volume 28233579-8a91-4401-9933-4679105bb46e {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:59:16 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3f4d76-36b6-42aa-90ec-f6100ba9e484]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:16 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e Jul 06 20:59:16 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:17 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa" returned: 0 in 0.913s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:17 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa Jul 06 20:59:17 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:17 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e" returned: 0 in 0.827s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:17 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248 1G Jul 06 20:59:17 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:17 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b520e17-698e-4378-b9c8-937a2bcb8cfa" returned: 0 in 0.708s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Lock "cinder-quobyte-4b520e17-698e-4378-b9c8-937a2bcb8cfa" released by "delete_volume" :: held 1.687s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:18 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Created reservations ['3a0be6e8-e0ca-43c0-a5de-05f1cb80082b', '2538418f-f9e9-44de-a83e-85c2a07ea532', 'd8a56a1a-3e92-470a-a71c-38ffe0406d9b', '8230769f-05ce-4106-be9f-61c0de879d14'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:59:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:59:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:59:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:18 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:59:18 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:18 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248 1G" returned: 0 in 0.920s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28233579-8a91-4401-9933-4679105bb46e -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:18 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28233579-8a91-4401-9933-4679105bb46e -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248 Jul 06 20:59:18 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:18 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.749s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:18 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:59:18 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Deleted volume successfully. Jul 06 20:59:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-521228f4-91a6-4d15-aaad-539068c58529 tempest-VolumesSnapshotNegativeTestJSON-286289248 None] Lock "cinder-4b520e17-698e-4378-b9c8-937a2bcb8cfa-delete_volume" released by "delete_volume" :: held 2.674s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:19 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28233579-8a91-4401-9933-4679105bb46e -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248" returned: 0 in 0.758s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:19 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248 is being set with open permissions: ugo+rw Jul 06 20:59:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:19 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248 Jul 06 20:59:19 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:19 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248" returned: 0 in 0.697s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:19 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.info Jul 06 20:59:19 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:20 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.info" returned: 0 in 0.656s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:20 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.info is being set with open permissions: ugo+rw Jul 06 20:59:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:20 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.info Jul 06 20:59:20 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:21 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.info" returned: 0 in 0.640s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.595s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:21 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9b5451ff-dec8-4af7-b402-8cb12d6d561d tempest-VolumesSnapshotTestJSON-976358095 None] Create snapshot completed successfully Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Flow 'volume_create_manager' (7ab7e9c7-eada-4f26-ae49-3f6b23ec8eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7abd03b8-881d-4bee-947b-afd3107d22a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7abd03b8-881d-4bee-947b-afd3107d22a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1781296213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40b572e-a750-47e2-b037-cadb7d9aea5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f7fff02cba4db78914cfa970474b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=87dea38f-9c54-4d20-9475-782998fce248,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:59:23Z,use_quota=True,user_id='5c81ca6c7d4140e2858f51f2c8f2c13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c853f2-8d54-47d8-85d9-93ec6886804d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c853f2-8d54-47d8-85d9-93ec6886804d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c599de68-3674-4821-86c9-13c7f09867e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c599de68-3674-4821-86c9-13c7f09867e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c40b572e-a750-47e2-b037-cadb7d9aea5c', 'volume_name': 'volume-c40b572e-a750-47e2-b037-cadb7d9aea5c', 'volume_size': 1, 'snapshot_id': '87dea38f-9c54-4d20-9475-782998fce248'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d4ad14-506f-45a4-a137-f0c86459b409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d4ad14-506f-45a4-a137-f0c86459b409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cdd906d-0135-40b1-9b7a-06ebcaab6bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:22 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Volume c40b572e-a750-47e2-b037-cadb7d9aea5c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c40b572e-a750-47e2-b037-cadb7d9aea5c', 'volume_size': 1, 'snapshot_id': '87dea38f-9c54-4d20-9475-782998fce248'} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-quobyte-87dea38f-9c54-4d20-9475-782998fce248-c40b572e-a750-47e2-b037-cadb7d9aea5c" by "_create_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-87dea38f-9c54-4d20-9475-782998fce248-c40b572e-a750-47e2-b037-cadb7d9aea5c" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Creating volume c40b572e-a750-47e2-b037-cadb7d9aea5c from snapshot 87dea38f-9c54-4d20-9475-782998fce248 {{(pid=87207) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-quobyte-c40b572e-a750-47e2-b037-cadb7d9aea5c" by "_copy_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-c40b572e-a750-47e2-b037-cadb7d9aea5c" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] snapshot: 87dea38f-9c54-4d20-9475-782998fce248, volume: c40b572e-a750-47e2-b037-cadb7d9aea5c, {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[335d32cc-1370-4ad3-a312-3efe6b52c8bb]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:22 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248 Jul 06 20:59:22 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:23 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248" returned: 0 in 0.789s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28233579-8a91-4401-9933-4679105bb46e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:59:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 20:59:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Creating direct copy from snapshot {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 20:59:23 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0481b78-d5ae-4c75-a6a3-34375c6d45a9]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:23 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e Jul 06 20:59:23 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:24 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e" returned: 0 in 0.805s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:24 devstack cinder-volume[87207]: DEBUG cinder.utils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Path /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c40b572e-a750-47e2-b037-cadb7d9aea5c not found in is_blk_device check {{(pid=87207) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 20:59:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c40b572e-a750-47e2-b037-cadb7d9aea5c {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:24 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c40b572e-a750-47e2-b037-cadb7d9aea5c Jul 06 20:59:24 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:29 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c40b572e-a750-47e2-b037-cadb7d9aea5c" returned: 0 in 5.383s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:29 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced77d7b-7aed-45c0-8183-a974ade4add0]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:29 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e Jul 06 20:59:29 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:30 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e" returned: 0 in 0.965s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:30 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Image conversion details: src /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c40b572e-a750-47e2-b037-cadb7d9aea5c {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 20:59:30 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Converted 1024.00 MB image at 190.18 MB/s Jul 06 20:59:30 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c40b572e-a750-47e2-b037-cadb7d9aea5c is being set with open permissions: ugo+rw Jul 06 20:59:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c40b572e-a750-47e2-b037-cadb7d9aea5c {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:30 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c40b572e-a750-47e2-b037-cadb7d9aea5c Jul 06 20:59:30 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:31 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c40b572e-a750-47e2-b037-cadb7d9aea5c" returned: 0 in 0.661s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:31 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-c40b572e-a750-47e2-b037-cadb7d9aea5c" released by "_copy_volume_from_snapshot" :: held 8.707s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:31 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-87dea38f-9c54-4d20-9475-782998fce248-c40b572e-a750-47e2-b037-cadb7d9aea5c" released by "_create_volume_from_snapshot" :: held 8.742s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.759s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cdd906d-0135-40b1-9b7a-06ebcaab6bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c40b572e-a750-47e2-b037-cadb7d9aea5c', 'volume_size': 1, 'snapshot_id': '87dea38f-9c54-4d20-9475-782998fce248'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d30376-1a86-47e4-840a-daf98d48151a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:31 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Volume volume-c40b572e-a750-47e2-b037-cadb7d9aea5c (c40b572e-a750-47e2-b037-cadb7d9aea5c): created successfully Jul 06 20:59:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d30376-1a86-47e4-840a-daf98d48151a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Flow 'volume_create_manager' (7ab7e9c7-eada-4f26-ae49-3f6b23ec8eae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:59:31 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-6a6b2110-35d0-4a19-a8f1-9ffdc9484343 tempest-VolumesSnapshotTestJSON-976358095 None] Created volume successfully. Jul 06 20:59:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-c40b572e-a750-47e2-b037-cadb7d9aea5c-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-c40b572e-a750-47e2-b037-cadb7d9aea5c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-quobyte-c40b572e-a750-47e2-b037-cadb7d9aea5c" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-c40b572e-a750-47e2-b037-cadb7d9aea5c" acquired by "delete_volume" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:32 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0d5a0d-6f8c-4980-9c75-19b5469946d3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c40b572e-a750-47e2-b037-cadb7d9aea5c {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:32 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c40b572e-a750-47e2-b037-cadb7d9aea5c Jul 06 20:59:32 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:33 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c40b572e-a750-47e2-b037-cadb7d9aea5c" returned: 0 in 0.849s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c40b572e-a750-47e2-b037-cadb7d9aea5c {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:33 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c40b572e-a750-47e2-b037-cadb7d9aea5c Jul 06 20:59:33 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:34 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c40b572e-a750-47e2-b037-cadb7d9aea5c" returned: 0 in 0.790s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-c40b572e-a750-47e2-b037-cadb7d9aea5c" released by "delete_volume" :: held 1.697s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] Created reservations ['6d19956b-1e9c-4550-9757-1aad6847f0ab', '1e1002ac-4f2b-4412-b8ff-3c1ce8a19a18', 'e19be90e-2ef7-47ff-8091-2a96eb475316', 'bcfcdddc-61de-4d6f-b7ac-2b4eee4d74d6'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:34 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:59:34 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-87dea38f-9c54-4d20-9475-782998fce248-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-87dea38f-9c54-4d20-9475-782998fce248-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-quobyte-28233579-8a91-4401-9933-4679105bb46e" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-28233579-8a91-4401-9933-4679105bb46e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-quobyte-87dea38f-9c54-4d20-9475-782998fce248" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-87dea38f-9c54-4d20-9475-782998fce248" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] Deleting offline snapshot 87dea38f-9c54-4d20-9475-782998fce248 of volume 28233579-8a91-4401-9933-4679105bb46e {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] snapshot_file for this snap is: volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e36d94-5d1c-4ef1-a6ce-210aae93c736]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:35 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248 Jul 06 20:59:35 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:35 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.655s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:35 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:59:35 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] Deleted volume successfully. Jul 06 20:59:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cefab8eb-65ae-444a-add9-f98e44ef3242 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-c40b572e-a750-47e2-b037-cadb7d9aea5c-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:35 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248" returned: 0 in 0.863s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28233579-8a91-4401-9933-4679105bb46e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:59:35 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8b2f74-5dd3-4e16-ac7b-33ca5dc827af]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:35 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e Jul 06 20:59:35 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:36 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e" returned: 0 in 0.834s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:36 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248 Jul 06 20:59:36 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:37 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248" returned: 0 in 0.880s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:37 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248 Jul 06 20:59:37 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:38 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e.87dea38f-9c54-4d20-9475-782998fce248" returned: 0 in 0.796s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-87dea38f-9c54-4d20-9475-782998fce248" released by "_delete_snapshot" :: held 3.502s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-28233579-8a91-4401-9933-4679105bb46e" released by "delete_snapshot" :: held 3.537s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:38 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] Created reservations ['b93b791a-37e2-4ca7-a312-9616b011751d', '42e8c6aa-2e8a-420c-9fb2-01b20354bfe0', 'a9409020-9ac8-4950-be51-bd2346800289', 'a2fbf73f-135d-4b70-a858-cfb50c0d00b0'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:59:38 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] Delete snapshot completed successfully. Jul 06 20:59:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d910b957-8807-4733-be4e-7840be8ff468 tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-87dea38f-9c54-4d20-9475-782998fce248-delete_snapshot" released by "delete_snapshot" :: held 3.716s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-28233579-8a91-4401-9933-4679105bb46e-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-28233579-8a91-4401-9933-4679105bb46e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-quobyte-28233579-8a91-4401-9933-4679105bb46e" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-28233579-8a91-4401-9933-4679105bb46e" acquired by "delete_volume" :: waited 0.027s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:39 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4ff7a3-531d-4857-937a-20d476fe05d4]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:39 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e Jul 06 20:59:39 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:40 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e" returned: 0 in 0.832s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:40 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e Jul 06 20:59:40 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:40 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-28233579-8a91-4401-9933-4679105bb46e" returned: 0 in 0.729s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-28233579-8a91-4401-9933-4679105bb46e" released by "delete_volume" :: held 1.651s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:40 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] Created reservations ['d43259e9-aa72-4465-9c43-c4d545f4b5b1', '4ef9439e-8743-4f62-933d-0c58819b3c65', '17c6b8f4-17a4-41be-9996-ba58e51da7fc', '708f54fc-036a-4b18-a8b2-09863350516b'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:59:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:41 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:59:41 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:59:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:41 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:59:41 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:41 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-119843a5-4029-432f-9d07-7a49329ed7c7-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:41 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-119843a5-4029-432f-9d07-7a49329ed7c7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:41 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "cinder-quobyte-119843a5-4029-432f-9d07-7a49329ed7c7" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 20:59:41 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-119843a5-4029-432f-9d07-7a49329ed7c7" acquired by "delete_volume" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 20:59:41 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea72d24-dec2-41cb-8497-8d10881ebc3c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:41 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.676s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:41 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:59:41 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] Deleted volume successfully. Jul 06 20:59:41 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5165cb6b-98e8-469d-9178-dc87ef1e3e1d tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-28233579-8a91-4401-9933-4679105bb46e-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:41 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7 Jul 06 20:59:41 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:42 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7" returned: 0 in 1.057s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:42 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7 Jul 06 20:59:42 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:43 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-119843a5-4029-432f-9d07-7a49329ed7c7" returned: 0 in 0.722s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-quobyte-119843a5-4029-432f-9d07-7a49329ed7c7" released by "delete_volume" :: held 1.863s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:43 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] Created reservations ['3949374a-5b6d-41b5-b1d2-0164e6844a33', '80482ee4-926a-4aaf-8ee5-afbad0e0a7cd', 'b7407720-c2a0-4b6b-9dbd-25c561a813ec', '8647c80b-8c41-411b-a8b4-a2f43595e876'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 20:59:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:59:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:59:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:43 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:59:43 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:44 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.719s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:44 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:59:44 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] Deleted volume successfully. Jul 06 20:59:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b03f9a51-5a67-4b78-ae81-67febd53235f tempest-VolumesSnapshotTestJSON-976358095 None] Lock "cinder-119843a5-4029-432f-9d07-7a49329ed7c7-delete_volume" released by "delete_volume" :: held 2.848s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=94,cinder:INSERT=25,cinder:UPDATE=126,cinder:DELETE=12 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=89,cinder:INSERT=35,cinder:UPDATE=110,cinder:DELETE=7 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Flow 'volume_create_manager' (7834389a-a440-485b-91c4-3c65b31a4de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a128a080-bb09-4cb7-a43e-330b93d8a191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a128a080-bb09-4cb7-a43e-330b93d8a191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1301323744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dcdd101-9523-47f0-8ece-855620e567d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8366a3ce596c4048a975317309625eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:59:50Z,use_quota=True,user_id='7c2f6da03c404f71ab40596d6b136b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6898fdf0-b8d9-4d0d-8fc9-bde7138d02a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6898fdf0-b8d9-4d0d-8fc9-bde7138d02a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd52b617-c63d-4d66-9343-76a85afa34dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd52b617-c63d-4d66-9343-76a85afa34dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dcdd101-9523-47f0-8ece-855620e567d1', 'volume_name': 'volume-6dcdd101-9523-47f0-8ece-855620e567d1', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6763b0-ae64-4c79-9bd4-4d4aff7cb668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6763b0-ae64-4c79-9bd4-4d4aff7cb668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a731f3a-99a5-4d36-a344-2f0a18f67bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:49 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Volume 6dcdd101-9523-47f0-8ece-855620e567d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dcdd101-9523-47f0-8ece-855620e567d1', 'volume_size': 1} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T18:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1301323744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dcdd101-9523-47f0-8ece-855620e567d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8366a3ce596c4048a975317309625eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:59:50Z,use_quota=True,user_id='7c2f6da03c404f71ab40596d6b136b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Creating volume 6dcdd101-9523-47f0-8ece-855620e567d1 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 20:59:49 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 20:59:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:49 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1 1073741824 Jul 06 20:59:49 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:50 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1 1073741824" returned: 0 in 0.785s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:50 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1 Jul 06 20:59:50 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:51 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1" returned: 0 in 0.649s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 20:59:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a731f3a-99a5-4d36-a344-2f0a18f67bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dcdd101-9523-47f0-8ece-855620e567d1', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066674c5-ce4c-4565-abcd-bd5e16e40cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 20:59:51 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Volume volume-6dcdd101-9523-47f0-8ece-855620e567d1 (6dcdd101-9523-47f0-8ece-855620e567d1): created successfully Jul 06 20:59:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066674c5-ce4c-4565-abcd-bd5e16e40cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 20:59:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Flow 'volume_create_manager' (7834389a-a440-485b-91c4-3c65b31a4de3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 20:59:51 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-7d6669ec-91d8-4575-9f0e-dc74e6976e5a tempest-VolumesSnapshotListTestJSON-1306588875 None] Created volume successfully. Jul 06 20:59:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] Creating offline snapshot 537c8778-ff0e-4a14-bc77-c3e33a99c4bf of volume 6dcdd101-9523-47f0-8ece-855620e567d1 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:59:52 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b51e52-229c-45f9-a057-8352e9d160c9]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:52 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1 Jul 06 20:59:52 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:52 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1" returned: 0 in 0.845s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:52 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf 1G Jul 06 20:59:52 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:53 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf 1G" returned: 0 in 0.905s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dcdd101-9523-47f0-8ece-855620e567d1 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:53 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dcdd101-9523-47f0-8ece-855620e567d1 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf Jul 06 20:59:53 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:54 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dcdd101-9523-47f0-8ece-855620e567d1 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf" returned: 0 in 0.696s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:54 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf is being set with open permissions: ugo+rw Jul 06 20:59:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:54 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf Jul 06 20:59:54 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:55 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf" returned: 0 in 0.658s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:55 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.info Jul 06 20:59:55 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:55 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.info" returned: 0 in 0.626s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:55 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.info is being set with open permissions: ugo+rw Jul 06 20:59:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:55 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.info Jul 06 20:59:55 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:56 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.info" returned: 0 in 0.628s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.443s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:56 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-770c0d6d-7ea9-4d06-a401-79fb567e894a tempest-VolumesSnapshotListTestJSON-1306588875 None] Create snapshot completed successfully Jul 06 20:59:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-755e61d1-588b-41b5-a193-6e5a03c1ab37 tempest-VolumesSnapshotListTestJSON-1306588875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-755e61d1-588b-41b5-a193-6e5a03c1ab37 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-755e61d1-588b-41b5-a193-6e5a03c1ab37 tempest-VolumesSnapshotListTestJSON-1306588875 None] Creating offline snapshot b2be56ca-4905-41cc-bbec-d8220171c660 of volume 6dcdd101-9523-47f0-8ece-855620e567d1 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 20:59:57 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6407001a-9f7e-4e3b-8179-7d6cf19e1c36]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 20:59:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-755e61d1-588b-41b5-a193-6e5a03c1ab37 tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:57 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf Jul 06 20:59:57 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:59:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 20:59:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 20:59:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 20:59:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 20:59:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 20:59:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:58 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 20:59:58 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:58 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-755e61d1-588b-41b5-a193-6e5a03c1ab37 tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf" returned: 0 in 0.777s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-755e61d1-588b-41b5-a193-6e5a03c1ab37 tempest-VolumesSnapshotListTestJSON-1306588875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dcdd101-9523-47f0-8ece-855620e567d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 20:59:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-755e61d1-588b-41b5-a193-6e5a03c1ab37 tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:58 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 1G Jul 06 20:59:58 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:59:58 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.661s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:59:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:59:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:59:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 20:59:59 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Jul 06 20:59:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-755e61d1-588b-41b5-a193-6e5a03c1ab37 tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 1G" returned: 0 in 0.828s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:59:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-755e61d1-588b-41b5-a193-6e5a03c1ab37 tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:59:59 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 Jul 06 20:59:59 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:00 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-755e61d1-588b-41b5-a193-6e5a03c1ab37 tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660" returned: 0 in 0.704s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:00 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-755e61d1-588b-41b5-a193-6e5a03c1ab37 tempest-VolumesSnapshotListTestJSON-1306588875 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 is being set with open permissions: ugo+rw Jul 06 21:00:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-755e61d1-588b-41b5-a193-6e5a03c1ab37 tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:00 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 Jul 06 21:00:00 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:00 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-755e61d1-588b-41b5-a193-6e5a03c1ab37 tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660" returned: 0 in 0.669s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-755e61d1-588b-41b5-a193-6e5a03c1ab37 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.084s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:00 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-755e61d1-588b-41b5-a193-6e5a03c1ab37 tempest-VolumesSnapshotListTestJSON-1306588875 None] Create snapshot completed successfully Jul 06 21:00:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e9dfb065-ea81-49a1-9506-bfcd09a9328d tempest-VolumesSnapshotListTestJSON-1306588875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e9dfb065-ea81-49a1-9506-bfcd09a9328d tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e9dfb065-ea81-49a1-9506-bfcd09a9328d tempest-VolumesSnapshotListTestJSON-1306588875 None] Creating offline snapshot 6709dd8a-7870-48cf-8bfb-5d362f05db8d of volume 6dcdd101-9523-47f0-8ece-855620e567d1 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:00:01 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da37e8f-579c-44fe-9a08-6c49c3f4abfd]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:00:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e9dfb065-ea81-49a1-9506-bfcd09a9328d tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:02 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 Jul 06 21:00:02 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:02 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:00:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Flow 'volume_create_manager' (8d2196c7-a7ab-4354-8199-32687a02e846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:00:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a1541f-c099-4cbd-ab66-1afadd7c8246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:02 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a1541f-c099-4cbd-ab66-1afadd7c8246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-384433926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13bbe65-e67f-43ff-8256-89e5817fbb16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ae69300bf741a0bdb35c9ef7fe1dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:00:03Z,use_quota=True,user_id='c501882bb04c4612960449adacae86bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566369f2-ed2a-45a0-80f0-04afc237c52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566369f2-ed2a-45a0-80f0-04afc237c52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fcc9b4f-0664-423b-ac7e-f06185029eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fcc9b4f-0664-423b-ac7e-f06185029eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b13bbe65-e67f-43ff-8256-89e5817fbb16', 'volume_name': 'volume-b13bbe65-e67f-43ff-8256-89e5817fbb16', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140efe79-1cf8-4de0-ac73-879d752689ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140efe79-1cf8-4de0-ac73-879d752689ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281733fd-b76a-414b-8f89-f71fe2c584dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:02 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Volume b13bbe65-e67f-43ff-8256-89e5817fbb16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b13bbe65-e67f-43ff-8256-89e5817fbb16', 'volume_size': 1} Jul 06 21:00:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e9dfb065-ea81-49a1-9506-bfcd09a9328d tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660" returned: 0 in 0.853s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e9dfb065-ea81-49a1-9506-bfcd09a9328d tempest-VolumesSnapshotListTestJSON-1306588875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dcdd101-9523-47f0-8ece-855620e567d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:00:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e9dfb065-ea81-49a1-9506-bfcd09a9328d tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:02 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d 1G Jul 06 21:00:02 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:03 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e9dfb065-ea81-49a1-9506-bfcd09a9328d tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d 1G" returned: 0 in 0.820s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e9dfb065-ea81-49a1-9506-bfcd09a9328d tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:03 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d Jul 06 21:00:03 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:04 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e9dfb065-ea81-49a1-9506-bfcd09a9328d tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d" returned: 0 in 0.644s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:04 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-e9dfb065-ea81-49a1-9506-bfcd09a9328d tempest-VolumesSnapshotListTestJSON-1306588875 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d is being set with open permissions: ugo+rw Jul 06 21:00:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e9dfb065-ea81-49a1-9506-bfcd09a9328d tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:04 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d Jul 06 21:00:04 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:04 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e9dfb065-ea81-49a1-9506-bfcd09a9328d tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d" returned: 0 in 0.609s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e9dfb065-ea81-49a1-9506-bfcd09a9328d tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.043s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.116s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-384433926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13bbe65-e67f-43ff-8256-89e5817fbb16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ae69300bf741a0bdb35c9ef7fe1dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:00:03Z,use_quota=True,user_id='c501882bb04c4612960449adacae86bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:00:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Creating volume b13bbe65-e67f-43ff-8256-89e5817fbb16 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:00:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:00:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:00:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:00:04 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:00:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b13bbe65-e67f-43ff-8256-89e5817fbb16 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:04 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b13bbe65-e67f-43ff-8256-89e5817fbb16 1073741824 Jul 06 21:00:04 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:04 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e9dfb065-ea81-49a1-9506-bfcd09a9328d tempest-VolumesSnapshotListTestJSON-1306588875 None] Create snapshot completed successfully Jul 06 21:00:05 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b13bbe65-e67f-43ff-8256-89e5817fbb16 1073741824" returned: 0 in 0.795s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b13bbe65-e67f-43ff-8256-89e5817fbb16 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:05 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b13bbe65-e67f-43ff-8256-89e5817fbb16 Jul 06 21:00:05 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:06 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b13bbe65-e67f-43ff-8256-89e5817fbb16" returned: 0 in 0.644s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:00:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281733fd-b76a-414b-8f89-f71fe2c584dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b13bbe65-e67f-43ff-8256-89e5817fbb16', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a58f07-485e-4a63-9758-55f7af1a1350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:06 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Volume volume-b13bbe65-e67f-43ff-8256-89e5817fbb16 (b13bbe65-e67f-43ff-8256-89e5817fbb16): created successfully Jul 06 21:00:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a58f07-485e-4a63-9758-55f7af1a1350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Flow 'volume_create_manager' (8d2196c7-a7ab-4354-8199-32687a02e846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:00:06 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-c3f64b33-bde6-4e4f-9d03-07da25b34a08 tempest-TestMinimumBasicScenario-46622118 None] Created volume successfully. Jul 06 21:00:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] Acquiring lock "cinder-6709dd8a-7870-48cf-8bfb-5d362f05db8d-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-6709dd8a-7870-48cf-8bfb-5d362f05db8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] Acquiring lock "cinder-quobyte-6dcdd101-9523-47f0-8ece-855620e567d1" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-quobyte-6dcdd101-9523-47f0-8ece-855620e567d1" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] Acquiring lock "cinder-quobyte-6709dd8a-7870-48cf-8bfb-5d362f05db8d" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-quobyte-6709dd8a-7870-48cf-8bfb-5d362f05db8d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] Deleting offline snapshot 6709dd8a-7870-48cf-8bfb-5d362f05db8d of volume 6dcdd101-9523-47f0-8ece-855620e567d1 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:00:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] snapshot_file for this snap is: volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:00:06 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[939c5564-f7a1-49b0-a651-c7f5b36e978d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:00:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:07 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d Jul 06 21:00:07 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:07 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d" returned: 0 in 0.806s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dcdd101-9523-47f0-8ece-855620e567d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:00:07 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe81b48f-7c8a-48a7-a5d7-9b5d98343660]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:00:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:07 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 Jul 06 21:00:07 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:08 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660" returned: 0 in 0.761s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dcdd101-9523-47f0-8ece-855620e567d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:00:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:08 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d Jul 06 21:00:08 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:09 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d" returned: 0 in 0.790s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:09 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d Jul 06 21:00:09 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:10 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.6709dd8a-7870-48cf-8bfb-5d362f05db8d" returned: 0 in 0.661s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-quobyte-6709dd8a-7870-48cf-8bfb-5d362f05db8d" released by "_delete_snapshot" :: held 3.130s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-quobyte-6dcdd101-9523-47f0-8ece-855620e567d1" released by "delete_snapshot" :: held 3.158s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:10 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] Created reservations ['404b9ba5-12b7-4d70-bbf5-1ad3efa791ff', '2c6db4e7-9900-408e-b2b5-c36e365b2981', '443c58da-64ac-4117-a9db-955d11cef4d1', 'a813967f-8972-486f-912f-46221323f36d'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:00:10 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] Delete snapshot completed successfully. Jul 06 21:00:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f53c754d-0d1a-4f7f-b9ef-cb7c9c8aa34e tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-6709dd8a-7870-48cf-8bfb-5d362f05db8d-delete_snapshot" released by "delete_snapshot" :: held 3.333s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-210521fb-f50f-4e0c-9183-c486534b38c8 req-f3244f6d-5a2e-46e7-8902-c8bcf3b77b40 tempest-TestMinimumBasicScenario-46622118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-210521fb-f50f-4e0c-9183-c486534b38c8 req-f3244f6d-5a2e-46e7-8902-c8bcf3b77b40 tempest-TestMinimumBasicScenario-46622118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:10 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db6404a-4f00-478b-8d7b-bcd93191bbf0]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:00:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-210521fb-f50f-4e0c-9183-c486534b38c8 req-f3244f6d-5a2e-46e7-8902-c8bcf3b77b40 tempest-TestMinimumBasicScenario-46622118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b13bbe65-e67f-43ff-8256-89e5817fbb16 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:10 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b13bbe65-e67f-43ff-8256-89e5817fbb16 Jul 06 21:00:10 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:11 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-210521fb-f50f-4e0c-9183-c486534b38c8 req-f3244f6d-5a2e-46e7-8902-c8bcf3b77b40 tempest-TestMinimumBasicScenario-46622118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b13bbe65-e67f-43ff-8256-89e5817fbb16" returned: 0 in 0.750s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-210521fb-f50f-4e0c-9183-c486534b38c8 req-f3244f6d-5a2e-46e7-8902-c8bcf3b77b40 tempest-TestMinimumBasicScenario-46622118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.767s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-210521fb-f50f-4e0c-9183-c486534b38c8 req-f3244f6d-5a2e-46e7-8902-c8bcf3b77b40 tempest-TestMinimumBasicScenario-46622118 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-b13bbe65-e67f-43ff-8256-89e5817fbb16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d97576a-187f-4add-8983-fe39b60d5a27', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:00:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] Acquiring lock "cinder-b2be56ca-4905-41cc-bbec-d8220171c660-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-b2be56ca-4905-41cc-bbec-d8220171c660-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] Acquiring lock "cinder-quobyte-6dcdd101-9523-47f0-8ece-855620e567d1" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-quobyte-6dcdd101-9523-47f0-8ece-855620e567d1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] Acquiring lock "cinder-quobyte-b2be56ca-4905-41cc-bbec-d8220171c660" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-quobyte-b2be56ca-4905-41cc-bbec-d8220171c660" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] Deleting offline snapshot b2be56ca-4905-41cc-bbec-d8220171c660 of volume 6dcdd101-9523-47f0-8ece-855620e567d1 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:00:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] snapshot_file for this snap is: volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:00:11 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-210521fb-f50f-4e0c-9183-c486534b38c8 req-f3244f6d-5a2e-46e7-8902-c8bcf3b77b40 tempest-TestMinimumBasicScenario-46622118 None] attachment_update completed successfully. Jul 06 21:00:11 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[831c2cf4-7c81-4045-b77c-6f645ff84593]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:00:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:11 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 Jul 06 21:00:11 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:12 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660" returned: 0 in 0.830s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dcdd101-9523-47f0-8ece-855620e567d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:00:12 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef459ff-8ee6-4785-aec1-ad82800aaee0]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:00:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:12 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf Jul 06 21:00:12 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:12 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf" returned: 0 in 0.773s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dcdd101-9523-47f0-8ece-855620e567d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:00:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:12 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 Jul 06 21:00:12 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:13 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660" returned: 0 in 0.805s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:13 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660 Jul 06 21:00:13 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:14 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.b2be56ca-4905-41cc-bbec-d8220171c660" returned: 0 in 0.669s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-quobyte-b2be56ca-4905-41cc-bbec-d8220171c660" released by "_delete_snapshot" :: held 3.174s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-quobyte-6dcdd101-9523-47f0-8ece-855620e567d1" released by "delete_snapshot" :: held 3.198s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:14 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] Created reservations ['db2a1cb7-aff9-421a-9072-a2ccaf30fa70', '7162fafd-42d4-4e77-a8f4-b74148627e28', '4a1ca49b-1f26-490b-94b0-f33c26db65db', 'dadf8fc1-1ccb-4fa6-a8b5-9f723a446dd5'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:00:14 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] Delete snapshot completed successfully. Jul 06 21:00:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-96ecf857-30c3-447f-b02f-90bb39b18eb3 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-b2be56ca-4905-41cc-bbec-d8220171c660-delete_snapshot" released by "delete_snapshot" :: held 3.337s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] Acquiring lock "cinder-537c8778-ff0e-4a14-bc77-c3e33a99c4bf-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-537c8778-ff0e-4a14-bc77-c3e33a99c4bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] Acquiring lock "cinder-quobyte-6dcdd101-9523-47f0-8ece-855620e567d1" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-quobyte-6dcdd101-9523-47f0-8ece-855620e567d1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] Acquiring lock "cinder-quobyte-537c8778-ff0e-4a14-bc77-c3e33a99c4bf" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-quobyte-537c8778-ff0e-4a14-bc77-c3e33a99c4bf" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] Deleting offline snapshot 537c8778-ff0e-4a14-bc77-c3e33a99c4bf of volume 6dcdd101-9523-47f0-8ece-855620e567d1 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:00:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] snapshot_file for this snap is: volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:00:15 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce780a8-a494-4776-9328-7589edc6f0b3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:00:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:15 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf Jul 06 21:00:15 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:16 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf" returned: 0 in 0.771s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dcdd101-9523-47f0-8ece-855620e567d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:00:16 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d52851-61c2-4351-a057-233d184c60ae]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:00:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:16 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1 Jul 06 21:00:16 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:17 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1" returned: 0 in 0.903s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:17 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf Jul 06 21:00:17 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:17 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf" returned: 0 in 0.783s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:17 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf Jul 06 21:00:17 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:18 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1.537c8778-ff0e-4a14-bc77-c3e33a99c4bf" returned: 0 in 0.773s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-quobyte-537c8778-ff0e-4a14-bc77-c3e33a99c4bf" released by "_delete_snapshot" :: held 3.384s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-quobyte-6dcdd101-9523-47f0-8ece-855620e567d1" released by "delete_snapshot" :: held 3.411s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:18 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] Created reservations ['c562753a-f795-4e9f-93df-b778af877972', '97edb4a4-8942-4566-ac62-6d6f837a7f52', '23c98dca-342b-4f7b-aaeb-1b63c99869b7', 'cbdb2561-99c1-4014-81c9-d1f5e552b0d0'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:00:18 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] Delete snapshot completed successfully. Jul 06 21:00:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-534499e0-6cdd-474d-8a9e-5d0e9d7f9e95 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-537c8778-ff0e-4a14-bc77-c3e33a99c4bf-delete_snapshot" released by "delete_snapshot" :: held 3.605s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] Acquiring lock "cinder-6dcdd101-9523-47f0-8ece-855620e567d1-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-6dcdd101-9523-47f0-8ece-855620e567d1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] Acquiring lock "cinder-quobyte-6dcdd101-9523-47f0-8ece-855620e567d1" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-quobyte-6dcdd101-9523-47f0-8ece-855620e567d1" acquired by "delete_volume" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:19 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[3269e36d-1740-4a44-a6a7-5e31fe6a0d0e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:00:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:19 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1 Jul 06 21:00:19 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:20 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1" returned: 0 in 0.850s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:20 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1 Jul 06 21:00:20 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:21 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6dcdd101-9523-47f0-8ece-855620e567d1" returned: 0 in 0.691s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:21 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-quobyte-6dcdd101-9523-47f0-8ece-855620e567d1" released by "delete_volume" :: held 1.616s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:21 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] Created reservations ['27e3d11f-ec33-48ec-9e71-cd9d67ed123e', 'a937706a-ffbd-49b8-a010-34097f4f82ec', '7a7c8b88-86cb-495c-a040-8b1667617b48', 'da5f5c27-9ff0-4484-8225-ff27b27fcac9'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:00:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:00:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:00:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:21 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:00:21 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:22 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.773s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:22 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:00:22 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] Deleted volume successfully. Jul 06 21:00:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-244146e0-ae85-4935-a190-4b6a0f7c98a7 tempest-VolumesSnapshotListTestJSON-1306588875 None] Lock "cinder-6dcdd101-9523-47f0-8ece-855620e567d1-delete_volume" released by "delete_volume" :: held 2.629s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Flow 'volume_create_manager' (3514ecf2-48df-494f-b461-29e03e4576ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b07d49-3edd-4258-bbde-d23e8c64ae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b07d49-3edd-4258-bbde-d23e8c64ae24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1275774181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c48e742-1cef-4317-88b2-5c31c0f91bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d83c212c038a47b0a174b9113abca040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:00:25Z,use_quota=True,user_id='49c77bcf24d04046a89fe171be7d3404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8691253-1912-4f42-9f01-43e1b84baf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8691253-1912-4f42-9f01-43e1b84baf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ce156e-b024-4f91-8839-5e1adb22ede5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ce156e-b024-4f91-8839-5e1adb22ede5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c48e742-1cef-4317-88b2-5c31c0f91bbb', 'volume_name': 'volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59741ef8-1566-4c53-a65e-1fc0e89cc564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59741ef8-1566-4c53-a65e-1fc0e89cc564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527e35a7-59c8-4fd2-95a9-5c2ca0da493a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:24 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Volume 6c48e742-1cef-4317-88b2-5c31c0f91bbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb', 'volume_size': 1} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1275774181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c48e742-1cef-4317-88b2-5c31c0f91bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d83c212c038a47b0a174b9113abca040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:00:25Z,use_quota=True,user_id='49c77bcf24d04046a89fe171be7d3404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Creating volume 6c48e742-1cef-4317-88b2-5c31c0f91bbb {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:00:24 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:00:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:24 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb 1073741824 Jul 06 21:00:24 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:25 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb 1073741824" returned: 0 in 0.841s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:25 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb Jul 06 21:00:25 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:26 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb" returned: 0 in 0.635s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:00:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527e35a7-59c8-4fd2-95a9-5c2ca0da493a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfb8a13-21bf-4dab-8a71-5c8794a4dc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:26 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Volume volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb (6c48e742-1cef-4317-88b2-5c31c0f91bbb): created successfully Jul 06 21:00:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfb8a13-21bf-4dab-8a71-5c8794a4dc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Flow 'volume_create_manager' (3514ecf2-48df-494f-b461-29e03e4576ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:00:26 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-145f1721-360d-4180-9f16-a8d00cb12292 tempest-VolumeDependencyTests-2074750737 None] Created volume successfully. Jul 06 21:00:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:27 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] Creating offline snapshot 45488eb7-d8ad-446e-905a-46a520a8022b of volume 6c48e742-1cef-4317-88b2-5c31c0f91bbb {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:00:27 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8343ce0d-d6dc-4894-877d-e9af6307ab0b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:00:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:27 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb Jul 06 21:00:27 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:28 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb" returned: 0 in 0.781s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:28 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b 1G Jul 06 21:00:28 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:28 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b 1G" returned: 0 in 0.800s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:28 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b Jul 06 21:00:28 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:29 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b" returned: 0 in 0.659s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:29 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b is being set with open permissions: ugo+rw Jul 06 21:00:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:29 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b Jul 06 21:00:29 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:30 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b" returned: 0 in 0.698s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:30 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.info Jul 06 21:00:30 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:30 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.info" returned: 0 in 0.633s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:30 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.info is being set with open permissions: ugo+rw Jul 06 21:00:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:30 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.info Jul 06 21:00:30 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:31 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.info" returned: 0 in 0.673s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.345s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:31 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-5f30ffad-cd1c-4948-b762-e6591ebe39f5 tempest-VolumeDependencyTests-2074750737 None] Create snapshot completed successfully Jul 06 21:00:32 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Flow 'volume_create_manager' (b1c80105-211b-45c2-9fa9-f7c17f265ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71302295-184f-4fb4-8fd1-f25f56a34104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71302295-184f-4fb4-8fd1-f25f56a34104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1247497849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fff2e42-36fc-4a60-8a20-c4526e5ea4eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d83c212c038a47b0a174b9113abca040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=45488eb7-d8ad-446e-905a-46a520a8022b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:00:33Z,use_quota=True,user_id='49c77bcf24d04046a89fe171be7d3404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fde25c-cd4c-4654-9ff9-04d4ab93ae40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fde25c-cd4c-4654-9ff9-04d4ab93ae40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b031c6ec-6db0-45ee-9c5d-d2052ad75e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b031c6ec-6db0-45ee-9c5d-d2052ad75e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7fff2e42-36fc-4a60-8a20-c4526e5ea4eb', 'volume_name': 'volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb', 'volume_size': 1, 'snapshot_id': '45488eb7-d8ad-446e-905a-46a520a8022b'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36686820-a41e-4a3a-b56e-85afdcb253fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36686820-a41e-4a3a-b56e-85afdcb253fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0f456d-efbf-45ee-af1f-64e1a259609a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:33 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Volume 7fff2e42-36fc-4a60-8a20-c4526e5ea4eb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb', 'volume_size': 1, 'snapshot_id': '45488eb7-d8ad-446e-905a-46a520a8022b'} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Acquiring lock "cinder-quobyte-45488eb7-d8ad-446e-905a-46a520a8022b-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb" by "_create_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Lock "cinder-quobyte-45488eb7-d8ad-446e-905a-46a520a8022b-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Creating volume 7fff2e42-36fc-4a60-8a20-c4526e5ea4eb from snapshot 45488eb7-d8ad-446e-905a-46a520a8022b {{(pid=87207) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Acquiring lock "cinder-quobyte-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb" by "_copy_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Lock "cinder-quobyte-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] snapshot: 45488eb7-d8ad-446e-905a-46a520a8022b, volume: 7fff2e42-36fc-4a60-8a20-c4526e5ea4eb, {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[65acfe22-7952-4575-a489-8959d595e926]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:33 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b Jul 06 21:00:33 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:33 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b" returned: 0 in 0.748s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Creating direct copy from snapshot {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0f1281-97a9-4cdb-987c-0509be9bdd1e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:00:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:34 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb Jul 06 21:00:34 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:34 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb" returned: 0 in 0.730s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:34 devstack cinder-volume[87207]: DEBUG cinder.utils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Path /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb not found in is_blk_device check {{(pid=87207) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 21:00:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:34 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb Jul 06 21:00:34 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:40 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb" returned: 0 in 5.459s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:40 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58f9f42-78e9-49b2-be51-6b0d5ebcab75]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:00:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:40 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb Jul 06 21:00:40 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:41 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb" returned: 0 in 0.931s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:41 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Image conversion details: src /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:00:41 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Converted 1024.00 MB image at 187.51 MB/s Jul 06 21:00:41 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb is being set with open permissions: ugo+rw Jul 06 21:00:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:41 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb Jul 06 21:00:41 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:41 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb" returned: 0 in 0.641s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:41 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Lock "cinder-quobyte-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb" released by "_copy_volume_from_snapshot" :: held 8.612s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:41 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Lock "cinder-quobyte-45488eb7-d8ad-446e-905a-46a520a8022b-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb" released by "_create_volume_from_snapshot" :: held 8.645s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.664s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0f456d-efbf-45ee-af1f-64e1a259609a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb', 'volume_size': 1, 'snapshot_id': '45488eb7-d8ad-446e-905a-46a520a8022b'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632840b0-47eb-46d1-8d30-e368a4a256e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:41 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Volume volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb (7fff2e42-36fc-4a60-8a20-c4526e5ea4eb): created successfully Jul 06 21:00:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632840b0-47eb-46d1-8d30-e368a4a256e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Flow 'volume_create_manager' (b1c80105-211b-45c2-9fa9-f7c17f265ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:00:41 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-54dd2cc3-b2f5-4021-970c-666f1d182b9a tempest-VolumeDependencyTests-2074750737 None] Created volume successfully. Jul 06 21:00:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] Acquiring lock "cinder-45488eb7-d8ad-446e-905a-46a520a8022b-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] Lock "cinder-45488eb7-d8ad-446e-905a-46a520a8022b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] Acquiring lock "cinder-quobyte-6c48e742-1cef-4317-88b2-5c31c0f91bbb" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] Lock "cinder-quobyte-6c48e742-1cef-4317-88b2-5c31c0f91bbb" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] Acquiring lock "cinder-quobyte-45488eb7-d8ad-446e-905a-46a520a8022b" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] Lock "cinder-quobyte-45488eb7-d8ad-446e-905a-46a520a8022b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] Deleting offline snapshot 45488eb7-d8ad-446e-905a-46a520a8022b of volume 6c48e742-1cef-4317-88b2-5c31c0f91bbb {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:00:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] snapshot_file for this snap is: volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:00:43 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3cb0d4-07a4-4f3a-b9ad-b4ea48d77b33]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:00:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:43 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b Jul 06 21:00:43 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:43 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b" returned: 0 in 0.825s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:00:43 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6249371-a174-4ca8-a581-85d40a76dd4b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:00:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:44 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb Jul 06 21:00:44 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:44 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb" returned: 0 in 0.706s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:44 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b Jul 06 21:00:44 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:45 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b" returned: 0 in 0.715s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:45 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b Jul 06 21:00:45 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:45 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb.45488eb7-d8ad-446e-905a-46a520a8022b" returned: 0 in 0.617s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:46 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] Lock "cinder-quobyte-45488eb7-d8ad-446e-905a-46a520a8022b" released by "_delete_snapshot" :: held 2.974s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:46 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] Lock "cinder-quobyte-6c48e742-1cef-4317-88b2-5c31c0f91bbb" released by "delete_snapshot" :: held 3.015s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:46 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] Created reservations ['d9deef28-69e0-4e0d-ba28-e55171e66b94', 'd049938f-4bd6-488e-9c10-f6f6029ceb4f', 'a27b7e57-95d8-48a7-8729-24de757b0c79', '8c06b322-61a0-4fba-b63e-993949f9a168'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:00:46 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] Delete snapshot completed successfully. Jul 06 21:00:46 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2fd6fcd4-9c4c-412a-8f50-df082cd29d89 tempest-VolumeDependencyTests-2074750737 None] Lock "cinder-45488eb7-d8ad-446e-905a-46a520a8022b-delete_snapshot" released by "delete_snapshot" :: held 3.175s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:46 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] Acquiring lock "cinder-6c48e742-1cef-4317-88b2-5c31c0f91bbb-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:46 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] Lock "cinder-6c48e742-1cef-4317-88b2-5c31c0f91bbb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:46 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] Acquiring lock "cinder-quobyte-6c48e742-1cef-4317-88b2-5c31c0f91bbb" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:46 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] Lock "cinder-quobyte-6c48e742-1cef-4317-88b2-5c31c0f91bbb" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:46 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ceac2a-de29-4015-9212-bcfeade64dcd]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:00:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:46 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb Jul 06 21:00:46 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:47 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb" returned: 0 in 0.824s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:47 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb Jul 06 21:00:47 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:47 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-6c48e742-1cef-4317-88b2-5c31c0f91bbb" returned: 0 in 0.654s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:47 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] Lock "cinder-quobyte-6c48e742-1cef-4317-88b2-5c31c0f91bbb" released by "delete_volume" :: held 1.534s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:47 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] Created reservations ['2e7c62b0-30ca-4b7d-b351-24f5dc50b704', '46cbe21c-1a82-4697-a6b1-8cc3f9a97416', '7c924394-ab62-4a19-9fd6-7a2d20ddfbe6', '4160fef1-2f85-481e-931e-a36ec50614f4'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:00:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:00:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:00:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:48 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:00:48 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] Acquiring lock "cinder-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] Lock "cinder-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] Acquiring lock "cinder-quobyte-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:00:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] Lock "cinder-quobyte-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb" acquired by "delete_volume" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:00:48 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[895f6c1f-7873-49d6-a120-452501e599cc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:00:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:48 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.682s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:48 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:00:48 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] Deleted volume successfully. Jul 06 21:00:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-582b844c-670d-40db-a614-bbcd0983c526 tempest-VolumeDependencyTests-2074750737 None] Lock "cinder-6c48e742-1cef-4317-88b2-5c31c0f91bbb-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:48 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb Jul 06 21:00:48 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:49 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb" returned: 0 in 0.773s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:49 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb Jul 06 21:00:49 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:50 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb" returned: 0 in 0.660s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] Lock "cinder-quobyte-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb" released by "delete_volume" :: held 1.483s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:50 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=62,cinder:UPDATE=58,cinder:DELETE=2,cinder:INSERT=11 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:00:50 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=53,cinder:INSERT=18,cinder:UPDATE=53,cinder:DELETE=8 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:00:50 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] Created reservations ['9abb4b80-0e3d-47f9-9222-95d4c691a227', 'fcf984e3-d7b7-4f6f-8532-6556872d26f2', '6599cf51-14d9-4df9-b372-054cb77b7b2c', 'd3578e2f-4372-46a5-ae20-2cfb5a6a4e9d'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:00:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:00:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:00:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:50 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:00:50 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:50 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.659s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:50 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:00:50 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] Deleted volume successfully. Jul 06 21:00:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-958119a6-7f88-40d0-9375-deb6926acd77 tempest-VolumeDependencyTests-2074750737 None] Lock "cinder-7fff2e42-36fc-4a60-8a20-c4526e5ea4eb-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Flow 'volume_create_manager' (3e9f4cf6-129c-4d0e-b973-5c42ccfc868a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6b93a6-6ec2-4cbf-b74b-5e1f486a808b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6b93a6-6ec2-4cbf-b74b-5e1f486a808b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7004054-0bfb-4d49-a7ab-e30a549881af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a68a4728cc49eb8fc7d610159b332e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:00:53Z,use_quota=True,user_id='918a31027bd34268a0a146c958c45e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a07d769-3cc5-4535-aea7-ed387349eccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a07d769-3cc5-4535-aea7-ed387349eccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4426d762-baac-4bed-be04-a476bdb23416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4426d762-baac-4bed-be04-a476bdb23416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7004054-0bfb-4d49-a7ab-e30a549881af', 'volume_name': 'volume-a7004054-0bfb-4d49-a7ab-e30a549881af', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eedf676-a93b-43d0-a5fd-703119f42fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eedf676-a93b-43d0-a5fd-703119f42fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd50426-1a04-4baa-bfbf-1ccc61442f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:53 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Volume a7004054-0bfb-4d49-a7ab-e30a549881af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7004054-0bfb-4d49-a7ab-e30a549881af', 'volume_size': 1} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7004054-0bfb-4d49-a7ab-e30a549881af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a68a4728cc49eb8fc7d610159b332e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:00:53Z,use_quota=True,user_id='918a31027bd34268a0a146c958c45e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Creating volume a7004054-0bfb-4d49-a7ab-e30a549881af {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:00:53 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:00:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a7004054-0bfb-4d49-a7ab-e30a549881af 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:53 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a7004054-0bfb-4d49-a7ab-e30a549881af 1073741824 Jul 06 21:00:53 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:54 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a7004054-0bfb-4d49-a7ab-e30a549881af 1073741824" returned: 0 in 0.799s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a7004054-0bfb-4d49-a7ab-e30a549881af {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:54 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a7004054-0bfb-4d49-a7ab-e30a549881af Jul 06 21:00:54 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:55 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a7004054-0bfb-4d49-a7ab-e30a549881af" returned: 0 in 0.606s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:00:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd50426-1a04-4baa-bfbf-1ccc61442f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7004054-0bfb-4d49-a7ab-e30a549881af', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc10dcf-0869-4e0f-adde-3db744dddab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:55 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Volume volume-a7004054-0bfb-4d49-a7ab-e30a549881af (a7004054-0bfb-4d49-a7ab-e30a549881af): created successfully Jul 06 21:00:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc10dcf-0869-4e0f-adde-3db744dddab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:55 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Flow 'volume_create_manager' (3e9f4cf6-129c-4d0e-b973-5c42ccfc868a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:00:55 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-6d29ea9e-6746-400b-b02f-e94161537f10 tempest-CinderUnicodeTest-1894447829 None] Created volume successfully. Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Flow 'volume_create_manager' (1446c1dc-32df-459a-a944-bad7acbc69e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdd4bf8-3b56-44fc-90b1-b1626bd38518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdd4bf8-3b56-44fc-90b1-b1626bd38518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:00:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2009222582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef909bed-797f-4776-a68e-2d6e7b376a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a68a4728cc49eb8fc7d610159b332e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:00:56Z,use_quota=True,user_id='918a31027bd34268a0a146c958c45e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc0c3ec-d40f-4041-a289-835cc24f2ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc0c3ec-d40f-4041-a289-835cc24f2ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3187e600-ff8d-43aa-b02e-afa45fb81382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3187e600-ff8d-43aa-b02e-afa45fb81382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef909bed-797f-4776-a68e-2d6e7b376a86', 'volume_name': 'volume-ef909bed-797f-4776-a68e-2d6e7b376a86', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686cefee-d8c2-49f5-b437-7cce20c558df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686cefee-d8c2-49f5-b437-7cce20c558df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7e719c-bfb4-44f9-b7c0-24d89fd256db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:56 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Volume ef909bed-797f-4776-a68e-2d6e7b376a86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef909bed-797f-4776-a68e-2d6e7b376a86', 'volume_size': 1} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:00:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2009222582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef909bed-797f-4776-a68e-2d6e7b376a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a68a4728cc49eb8fc7d610159b332e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:00:56Z,use_quota=True,user_id='918a31027bd34268a0a146c958c45e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Creating volume ef909bed-797f-4776-a68e-2d6e7b376a86 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:00:56 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:56 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86 1073741824 Jul 06 21:00:56 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:56 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86 1073741824" returned: 0 in 0.795s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:56 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86 Jul 06 21:00:57 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:57 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86" returned: 0 in 0.724s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:00:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7e719c-bfb4-44f9-b7c0-24d89fd256db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef909bed-797f-4776-a68e-2d6e7b376a86', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1fcf5a-3d2f-4b82-a4d1-25eeacd40ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:00:57 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Volume volume-ef909bed-797f-4776-a68e-2d6e7b376a86 (ef909bed-797f-4776-a68e-2d6e7b376a86): created successfully Jul 06 21:00:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1fcf5a-3d2f-4b82-a4d1-25eeacd40ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:00:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Flow 'volume_create_manager' (1446c1dc-32df-459a-a944-bad7acbc69e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:00:57 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-5052b10d-563b-4d17-9949-48affaf45905 tempest-CinderUnicodeTest-1894447829 None] Created volume successfully. Jul 06 21:00:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:00:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:00:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:00:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:00:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:58 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:00:58 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:00:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:00:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] Creating offline snapshot 5e382ee0-cdeb-4a82-a4b5-4585e69fe237 of volume ef909bed-797f-4776-a68e-2d6e7b376a86 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:00:58 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e255e4b3-b52a-4c8a-8be9-0bbf970ecb03]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:00:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:58 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86 Jul 06 21:00:58 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:58 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.697s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:00:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:00:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:00:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:00:59 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86" returned: 0 in 0.810s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:59 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237 1G Jul 06 21:00:59 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:00 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237 1G" returned: 0 in 0.850s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef909bed-797f-4776-a68e-2d6e7b376a86 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:00 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef909bed-797f-4776-a68e-2d6e7b376a86 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237 Jul 06 21:01:00 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:00 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef909bed-797f-4776-a68e-2d6e7b376a86 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237" returned: 0 in 0.760s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:00 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237 is being set with open permissions: ugo+rw Jul 06 21:01:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:01 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237 Jul 06 21:01:01 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:01 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237" returned: 0 in 0.783s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:01 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.info Jul 06 21:01:01 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:02 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.info" returned: 0 in 0.648s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:02 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.info is being set with open permissions: ugo+rw Jul 06 21:01:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:02 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.info Jul 06 21:01:02 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:02 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-7200b65c-b359-4e25-9910-ba88d33bb014 req-454fb3a0-d2e3-4f58-9cc4-27a5b9abecec tempest-TestMinimumBasicScenario-46622118 None] Terminate volume connection completed successfully. Jul 06 21:01:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-7200b65c-b359-4e25-9910-ba88d33bb014 req-454fb3a0-d2e3-4f58-9cc4-27a5b9abecec tempest-TestMinimumBasicScenario-46622118 None] Deleting attachment 7d97576a-187f-4add-8983-fe39b60d5a27. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:01:03 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.info" returned: 0 in 0.654s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.598s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:01:03 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9648703c-e7fd-463b-b255-c1268dc70f4b tempest-CinderUnicodeTest-1894447829 None] Create snapshot completed successfully Jul 06 21:01:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] Acquiring lock "cinder-5e382ee0-cdeb-4a82-a4b5-4585e69fe237-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:01:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] Lock "cinder-5e382ee0-cdeb-4a82-a4b5-4585e69fe237-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:01:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] Acquiring lock "cinder-quobyte-ef909bed-797f-4776-a68e-2d6e7b376a86" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:01:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] Lock "cinder-quobyte-ef909bed-797f-4776-a68e-2d6e7b376a86" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:01:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] Acquiring lock "cinder-quobyte-5e382ee0-cdeb-4a82-a4b5-4585e69fe237" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:01:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] Lock "cinder-quobyte-5e382ee0-cdeb-4a82-a4b5-4585e69fe237" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:01:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] Deleting offline snapshot 5e382ee0-cdeb-4a82-a4b5-4585e69fe237 of volume ef909bed-797f-4776-a68e-2d6e7b376a86 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:01:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] snapshot_file for this snap is: volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:01:03 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0379b16e-797b-44cc-b07c-cf8f818377c3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:01:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:03 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237 Jul 06 21:01:03 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:04 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237" returned: 0 in 0.729s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef909bed-797f-4776-a68e-2d6e7b376a86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:01:04 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2c3bb5-a57a-4b33-9bf5-ef838287692f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:01:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:04 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86 Jul 06 21:01:04 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] Acquiring lock "cinder-b13bbe65-e67f-43ff-8256-89e5817fbb16-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:01:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] Lock "cinder-b13bbe65-e67f-43ff-8256-89e5817fbb16-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:01:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] Acquiring lock "cinder-quobyte-b13bbe65-e67f-43ff-8256-89e5817fbb16" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:01:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] Lock "cinder-quobyte-b13bbe65-e67f-43ff-8256-89e5817fbb16" acquired by "delete_volume" :: waited 0.013s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:01:05 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[317d051f-15bf-41eb-b208-32704e289702]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:01:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b13bbe65-e67f-43ff-8256-89e5817fbb16 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:05 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b13bbe65-e67f-43ff-8256-89e5817fbb16 Jul 06 21:01:05 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:05 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86" returned: 0 in 0.758s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:05 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237 Jul 06 21:01:05 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:05 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b13bbe65-e67f-43ff-8256-89e5817fbb16" returned: 0 in 0.763s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b13bbe65-e67f-43ff-8256-89e5817fbb16 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:05 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b13bbe65-e67f-43ff-8256-89e5817fbb16 Jul 06 21:01:05 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:06 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237" returned: 0 in 0.708s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:06 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237 Jul 06 21:01:06 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:06 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b13bbe65-e67f-43ff-8256-89e5817fbb16" returned: 0 in 0.640s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] Lock "cinder-quobyte-b13bbe65-e67f-43ff-8256-89e5817fbb16" released by "delete_volume" :: held 1.446s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:01:06 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] Created reservations ['12699c73-5c31-485b-8998-3d57f1c49bf6', 'cf14e2ed-25bb-4f62-a6db-4f2e71ecca36', '6622fd45-95b3-4129-9bec-252e3d845e12', 'a2983f1b-d822-40ee-a653-ea1c4ff57079'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:01:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:01:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:01:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:01:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:01:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:01:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:06 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:01:06 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:06 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86.5e382ee0-cdeb-4a82-a4b5-4585e69fe237" returned: 0 in 0.660s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] Lock "cinder-quobyte-5e382ee0-cdeb-4a82-a4b5-4585e69fe237" released by "_delete_snapshot" :: held 2.957s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:01:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] Lock "cinder-quobyte-ef909bed-797f-4776-a68e-2d6e7b376a86" released by "delete_snapshot" :: held 2.982s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:01:06 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] Created reservations ['a5383bb1-b75c-457f-8b48-d04cef491905', '95b41dc0-f384-4168-bba9-b6e19648414b', '3e516a50-ccb6-4b08-ac6e-6cc8152bc32d', '8f8f4264-e39e-4860-88c0-1ba896af3868'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:01:06 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] Delete snapshot completed successfully. Jul 06 21:01:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-34c2804a-3679-4f8d-b6dc-8f49bf5bea5d tempest-CinderUnicodeTest-1894447829 None] Lock "cinder-5e382ee0-cdeb-4a82-a4b5-4585e69fe237-delete_snapshot" released by "delete_snapshot" :: held 3.127s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:01:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] Acquiring lock "cinder-ef909bed-797f-4776-a68e-2d6e7b376a86-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:01:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] Lock "cinder-ef909bed-797f-4776-a68e-2d6e7b376a86-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:01:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] Acquiring lock "cinder-quobyte-ef909bed-797f-4776-a68e-2d6e7b376a86" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:01:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] Lock "cinder-quobyte-ef909bed-797f-4776-a68e-2d6e7b376a86" acquired by "delete_volume" :: waited 0.013s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:01:07 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58ea1cb-1331-4965-815e-2c8441397d9d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:01:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:07 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86 Jul 06 21:01:07 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:07 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.676s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:07 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:01:07 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] Deleted volume successfully. Jul 06 21:01:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6cd6a442-7261-47bf-b098-fb33e4116434 tempest-TestMinimumBasicScenario-46622118 None] Lock "cinder-b13bbe65-e67f-43ff-8256-89e5817fbb16-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:01:07 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86" returned: 0 in 0.796s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:07 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86 Jul 06 21:01:07 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:08 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef909bed-797f-4776-a68e-2d6e7b376a86" returned: 0 in 0.621s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] Lock "cinder-quobyte-ef909bed-797f-4776-a68e-2d6e7b376a86" released by "delete_volume" :: held 1.474s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:01:08 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] Created reservations ['bce47f32-ede0-4e01-87b4-f1f202d5e88c', 'c9398a45-7b11-45e3-8d6c-9f8322660711', '918aa359-31a3-4d6e-9e5a-f181c86a9b93', 'bfcbf118-ce35-4dfb-a7e6-09235a8b2c27'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:01:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:01:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:01:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:01:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:01:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:01:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:08 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:01:08 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:09 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] Acquiring lock "cinder-a7004054-0bfb-4d49-a7ab-e30a549881af-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:01:09 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] Lock "cinder-a7004054-0bfb-4d49-a7ab-e30a549881af-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:01:09 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] Acquiring lock "cinder-quobyte-a7004054-0bfb-4d49-a7ab-e30a549881af" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:01:09 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] Lock "cinder-quobyte-a7004054-0bfb-4d49-a7ab-e30a549881af" acquired by "delete_volume" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:01:09 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4246f12c-cd85-4f00-a6d6-5795347ef5f1]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:01:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a7004054-0bfb-4d49-a7ab-e30a549881af {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:09 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.870s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:09 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:01:09 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] Deleted volume successfully. Jul 06 21:01:09 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a6225b98-f384-415b-a134-367a3455dee2 tempest-CinderUnicodeTest-1894447829 None] Lock "cinder-ef909bed-797f-4776-a68e-2d6e7b376a86-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:01:09 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a7004054-0bfb-4d49-a7ab-e30a549881af Jul 06 21:01:09 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:10 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a7004054-0bfb-4d49-a7ab-e30a549881af" returned: 0 in 0.900s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a7004054-0bfb-4d49-a7ab-e30a549881af {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:10 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a7004054-0bfb-4d49-a7ab-e30a549881af Jul 06 21:01:10 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:10 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a7004054-0bfb-4d49-a7ab-e30a549881af" returned: 0 in 0.671s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] Lock "cinder-quobyte-a7004054-0bfb-4d49-a7ab-e30a549881af" released by "delete_volume" :: held 1.622s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:01:11 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] Created reservations ['99485978-b997-4bad-9311-7e3d032ced76', '61d780ef-1c0d-498a-b0ea-b46dc441901f', 'fcdaf3cd-e965-49f4-8bb0-f9511cfbc560', '768fe909-bdd1-4522-b2f1-3ca1c1aab389'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:01:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:01:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:01:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:01:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:01:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:01:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:11 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:01:11 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:11 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.649s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:11 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:01:11 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] Deleted volume successfully. Jul 06 21:01:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-86e5ec44-599e-4921-94c1-e4b6e86bc277 tempest-CinderUnicodeTest-1894447829 None] Lock "cinder-a7004054-0bfb-4d49-a7ab-e30a549881af-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:01:21 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:UPDATE=49,cinder:SELECT=22,cinder:DELETE=5,cinder:INSERT=10 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:01:21 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=43,cinder:INSERT=13,cinder:UPDATE=41,cinder:DELETE=2 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Flow 'volume_create_manager' (b368825d-68fa-4058-a7f1-da68b9734157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db8a8cb-5540-467c-ab95-6417664ae3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db8a8cb-5540-467c-ab95-6417664ae3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1743711181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b99f5b9c-e358-499a-a49a-d040edbd601e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9130ed9a082545ad849a59fa6dd1481e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:43Z,use_quota=True,user_id='d3f1b2a947974c94a6a05aa71fdca313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9052e30e-0834-4a59-9803-f8f0ca49b615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9052e30e-0834-4a59-9803-f8f0ca49b615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc097635-999a-4cab-9c7c-872f9d0de5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc097635-999a-4cab-9c7c-872f9d0de5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b99f5b9c-e358-499a-a49a-d040edbd601e', 'volume_name': 'volume-b99f5b9c-e358-499a-a49a-d040edbd601e', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caff516c-a496-4a90-a058-cb62f78033e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caff516c-a496-4a90-a058-cb62f78033e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686cad77-e87b-46dd-b44a-adb11d625f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:43 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Volume b99f5b9c-e358-499a-a49a-d040edbd601e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b99f5b9c-e358-499a-a49a-d040edbd601e', 'volume_size': 1} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1743711181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b99f5b9c-e358-499a-a49a-d040edbd601e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9130ed9a082545ad849a59fa6dd1481e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:43Z,use_quota=True,user_id='d3f1b2a947974c94a6a05aa71fdca313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Creating volume b99f5b9c-e358-499a-a49a-d040edbd601e {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:01:43 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:01:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:43 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e 1073741824 Jul 06 21:01:43 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:44 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e 1073741824" returned: 0 in 0.958s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:44 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e Jul 06 21:01:44 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:44 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e" returned: 0 in 0.706s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:01:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:01:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686cad77-e87b-46dd-b44a-adb11d625f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b99f5b9c-e358-499a-a49a-d040edbd601e', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7282bde8-a7c7-4281-8af7-3edff3d32daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:44 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Volume volume-b99f5b9c-e358-499a-a49a-d040edbd601e (b99f5b9c-e358-499a-a49a-d040edbd601e): created successfully Jul 06 21:01:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7282bde8-a7c7-4281-8af7-3edff3d32daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Flow 'volume_create_manager' (b368825d-68fa-4058-a7f1-da68b9734157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:01:44 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-a07df386-05b4-4d2d-816b-7f98c3ae0e6b tempest-SnapshotDependencyTests-1312157360 None] Created volume successfully. Jul 06 21:01:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:01:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:01:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] Creating offline snapshot 6f1e1bf4-556f-4214-91f0-4f2105a2eb30 of volume b99f5b9c-e358-499a-a49a-d040edbd601e {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:01:45 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d91f538-2cd9-4f58-bc1e-c84903b309bc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:01:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:45 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e Jul 06 21:01:45 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:46 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e" returned: 0 in 0.770s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:46 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30 1G Jul 06 21:01:46 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:47 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30 1G" returned: 0 in 0.947s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99f5b9c-e358-499a-a49a-d040edbd601e -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:47 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99f5b9c-e358-499a-a49a-d040edbd601e -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30 Jul 06 21:01:47 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:47 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99f5b9c-e358-499a-a49a-d040edbd601e -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30" returned: 0 in 0.741s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:47 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30 is being set with open permissions: ugo+rw Jul 06 21:01:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:47 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30 Jul 06 21:01:47 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:48 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30" returned: 0 in 0.731s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:48 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.info Jul 06 21:01:48 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:49 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.info" returned: 0 in 0.711s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:49 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.info is being set with open permissions: ugo+rw Jul 06 21:01:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:49 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.info Jul 06 21:01:49 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:50 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.info" returned: 0 in 0.761s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.776s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:01:50 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-354bb6a8-6c33-4b0a-a049-64c861c70872 tempest-SnapshotDependencyTests-1312157360 None] Create snapshot completed successfully Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Flow 'volume_create_manager' (affc6bf8-d85b-4670-9aa4-3fab19064588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac137fc8-6222-4a4e-9cd3-e7523d471a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac137fc8-6222-4a4e-9cd3-e7523d471a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1058906006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532cf499-239e-48ba-a72c-c004b8fa4308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb735ec93854997a46dc4cbf03ca570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:51Z,use_quota=True,user_id='3da20bf17f384b619ac060d2d5d0cfd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9ca3ff-8ff3-48aa-ba57-1d14dedebe0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9ca3ff-8ff3-48aa-ba57-1d14dedebe0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddf0be5-b6a1-40b6-9cfd-d879a99d7886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddf0be5-b6a1-40b6-9cfd-d879a99d7886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '532cf499-239e-48ba-a72c-c004b8fa4308', 'volume_name': 'volume-532cf499-239e-48ba-a72c-c004b8fa4308', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0e14c9-ea93-4e39-a225-6081c0052362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0e14c9-ea93-4e39-a225-6081c0052362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d08200-f890-46fc-9cf8-14ceec9f6ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:51 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Volume 532cf499-239e-48ba-a72c-c004b8fa4308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-532cf499-239e-48ba-a72c-c004b8fa4308', 'volume_size': 1} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1058906006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532cf499-239e-48ba-a72c-c004b8fa4308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb735ec93854997a46dc4cbf03ca570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:51Z,use_quota=True,user_id='3da20bf17f384b619ac060d2d5d0cfd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Creating volume 532cf499-239e-48ba-a72c-c004b8fa4308 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:01:51 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-532cf499-239e-48ba-a72c-c004b8fa4308 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:51 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-532cf499-239e-48ba-a72c-c004b8fa4308 1073741824 Jul 06 21:01:51 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Flow 'volume_create_manager' (84c0717d-acdc-48fc-99e7-189bd96e0fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0e9264-e789-4408-9f96-73747bd0d8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0e9264-e789-4408-9f96-73747bd0d8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02581971-8946-4a2b-96ed-22ebbcd3f046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9130ed9a082545ad849a59fa6dd1481e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6f1e1bf4-556f-4214-91f0-4f2105a2eb30,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:51Z,use_quota=True,user_id='d3f1b2a947974c94a6a05aa71fdca313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98036d1-3b83-4bdb-b9f8-34652414f709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98036d1-3b83-4bdb-b9f8-34652414f709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df09c42-219b-46a5-80a8-dfe830208058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df09c42-219b-46a5-80a8-dfe830208058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '02581971-8946-4a2b-96ed-22ebbcd3f046', 'volume_name': 'volume-02581971-8946-4a2b-96ed-22ebbcd3f046', 'volume_size': 1, 'snapshot_id': '6f1e1bf4-556f-4214-91f0-4f2105a2eb30'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad2531c-2e64-4112-9885-47610f1fc006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad2531c-2e64-4112-9885-47610f1fc006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e9af75-d377-4934-b620-f5845a1e64d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:51 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Volume 02581971-8946-4a2b-96ed-22ebbcd3f046: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-02581971-8946-4a2b-96ed-22ebbcd3f046', 'volume_size': 1, 'snapshot_id': '6f1e1bf4-556f-4214-91f0-4f2105a2eb30'} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Flow 'volume_create_manager' (ec27cfae-5466-4f28-a188-5c22a3467119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec9f68f-5ca8-4213-9cd7-5a1be8adab5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec9f68f-5ca8-4213-9cd7-5a1be8adab5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1110648445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce6aa13-91f4-4ee9-8482-8bbac437d9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb735ec93854997a46dc4cbf03ca570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:52Z,use_quota=True,user_id='3da20bf17f384b619ac060d2d5d0cfd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0162e00-88b8-4a2b-885a-e0cdf9d00fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0162e00-88b8-4a2b-885a-e0cdf9d00fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a481456-2eaa-4214-9d4a-cca54c565820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a481456-2eaa-4214-9d4a-cca54c565820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ce6aa13-91f4-4ee9-8482-8bbac437d9f7', 'volume_name': 'volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e1c701-18ba-4446-bd3f-09f86c90a048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e1c701-18ba-4446-bd3f-09f86c90a048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5690789-3534-478e-957f-35b1708ac139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:51 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Volume 7ce6aa13-91f4-4ee9-8482-8bbac437d9f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7', 'volume_size': 1} Jul 06 21:01:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:01:52 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-532cf499-239e-48ba-a72c-c004b8fa4308 1073741824" returned: 0 in 1.037s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-532cf499-239e-48ba-a72c-c004b8fa4308 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:52 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-532cf499-239e-48ba-a72c-c004b8fa4308 Jul 06 21:01:52 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:52 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-532cf499-239e-48ba-a72c-c004b8fa4308" returned: 0 in 0.638s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.424s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Acquiring lock "cinder-quobyte-6f1e1bf4-556f-4214-91f0-4f2105a2eb30-02581971-8946-4a2b-96ed-22ebbcd3f046" by "_create_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d08200-f890-46fc-9cf8-14ceec9f6ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-532cf499-239e-48ba-a72c-c004b8fa4308', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a6f545-8609-44e8-84ce-eed129f4b689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Lock "cinder-quobyte-6f1e1bf4-556f-4214-91f0-4f2105a2eb30-02581971-8946-4a2b-96ed-22ebbcd3f046" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Creating volume 02581971-8946-4a2b-96ed-22ebbcd3f046 from snapshot 6f1e1bf4-556f-4214-91f0-4f2105a2eb30 {{(pid=87207) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Acquiring lock "cinder-quobyte-02581971-8946-4a2b-96ed-22ebbcd3f046" by "_copy_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Lock "cinder-quobyte-02581971-8946-4a2b-96ed-22ebbcd3f046" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] snapshot: 6f1e1bf4-556f-4214-91f0-4f2105a2eb30, volume: 02581971-8946-4a2b-96ed-22ebbcd3f046, {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 21:01:52 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Volume volume-532cf499-239e-48ba-a72c-c004b8fa4308 (532cf499-239e-48ba-a72c-c004b8fa4308): created successfully Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a6f545-8609-44e8-84ce-eed129f4b689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:01:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Flow 'volume_create_manager' (affc6bf8-d85b-4670-9aa4-3fab19064588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:01:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:01:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:01:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:01:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:01:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:01:53 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9706b758-62e1-4fc1-b6ed-a39abe233f25 tempest-TestServerVolumeAttachmentScenario-634069070 None] Created volume successfully. Jul 06 21:01:53 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef6cc66-03e3-4438-8dc0-1b1867376226]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:01:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:53 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30 Jul 06 21:01:53 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:53 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30" returned: 0 in 0.809s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b99f5b9c-e358-499a-a49a-d040edbd601e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:01:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 21:01:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Creating direct copy from snapshot {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 21:01:53 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f118dc-693f-45b5-a3f1-5175507ab4f5]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:01:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:53 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e Jul 06 21:01:53 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:54 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e" returned: 0 in 0.865s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:54 devstack cinder-volume[87207]: DEBUG cinder.utils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Path /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-02581971-8946-4a2b-96ed-22ebbcd3f046 not found in is_blk_device check {{(pid=87207) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 21:01:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-02581971-8946-4a2b-96ed-22ebbcd3f046 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:54 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-02581971-8946-4a2b-96ed-22ebbcd3f046 Jul 06 21:01:54 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:01:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:01:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:01:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:01:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:01:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:01:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:58 devstack sudo[102074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:01:58 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:59 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.620s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:59 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:01:59 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:01:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:01:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:01:59 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-02581971-8946-4a2b-96ed-22ebbcd3f046" returned: 0 in 5.046s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:59 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c37682e-7362-47df-9d4c-9fc5b0d55781]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:01:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:59 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e Jul 06 21:01:59 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:00 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e" returned: 0 in 1.064s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:00 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Image conversion details: src /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-02581971-8946-4a2b-96ed-22ebbcd3f046 {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:02:00 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Converted 1024.00 MB image at 202.90 MB/s Jul 06 21:02:00 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-02581971-8946-4a2b-96ed-22ebbcd3f046 is being set with open permissions: ugo+rw Jul 06 21:02:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-02581971-8946-4a2b-96ed-22ebbcd3f046 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:00 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-02581971-8946-4a2b-96ed-22ebbcd3f046 Jul 06 21:02:00 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:01 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-02581971-8946-4a2b-96ed-22ebbcd3f046" returned: 0 in 0.688s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:01 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Lock "cinder-quobyte-02581971-8946-4a2b-96ed-22ebbcd3f046" released by "_copy_volume_from_snapshot" :: held 8.597s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:02:01 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Lock "cinder-quobyte-6f1e1bf4-556f-4214-91f0-4f2105a2eb30-02581971-8946-4a2b-96ed-22ebbcd3f046" released by "_create_volume_from_snapshot" :: held 8.634s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:02:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.664s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:02:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.854s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:02:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1110648445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce6aa13-91f4-4ee9-8482-8bbac437d9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb735ec93854997a46dc4cbf03ca570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:52Z,use_quota=True,user_id='3da20bf17f384b619ac060d2d5d0cfd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:02:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Creating volume 7ce6aa13-91f4-4ee9-8482-8bbac437d9f7 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:02:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:02:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:02:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:02:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:02:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:02:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:02:01 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:02:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:01 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7 1073741824 Jul 06 21:02:01 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e9af75-d377-4934-b620-f5845a1e64d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02581971-8946-4a2b-96ed-22ebbcd3f046', 'volume_size': 1, 'snapshot_id': '6f1e1bf4-556f-4214-91f0-4f2105a2eb30'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:02:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e2d38a-a33d-4907-923b-26a29f75fb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:02:01 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Volume volume-02581971-8946-4a2b-96ed-22ebbcd3f046 (02581971-8946-4a2b-96ed-22ebbcd3f046): created successfully Jul 06 21:02:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e2d38a-a33d-4907-923b-26a29f75fb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:02:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Flow 'volume_create_manager' (84c0717d-acdc-48fc-99e7-189bd96e0fe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:02:01 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e46835ed-c12e-4c5e-b41a-6b45037ec5ef tempest-SnapshotDependencyTests-1312157360 None] Created volume successfully. Jul 06 21:02:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] Acquiring lock "cinder-6f1e1bf4-556f-4214-91f0-4f2105a2eb30-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:02:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] Lock "cinder-6f1e1bf4-556f-4214-91f0-4f2105a2eb30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:02:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] Acquiring lock "cinder-quobyte-b99f5b9c-e358-499a-a49a-d040edbd601e" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:02:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] Lock "cinder-quobyte-b99f5b9c-e358-499a-a49a-d040edbd601e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:02:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] Acquiring lock "cinder-quobyte-6f1e1bf4-556f-4214-91f0-4f2105a2eb30" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:02:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] Lock "cinder-quobyte-6f1e1bf4-556f-4214-91f0-4f2105a2eb30" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:02:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] Deleting offline snapshot 6f1e1bf4-556f-4214-91f0-4f2105a2eb30 of volume b99f5b9c-e358-499a-a49a-d040edbd601e {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:02:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] snapshot_file for this snap is: volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:02:02 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[06033e4b-6f58-42cd-9d9b-157e0ad7c9b3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:02:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:02 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30 Jul 06 21:02:02 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:02 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7 1073741824" returned: 0 in 0.968s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:02 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7 Jul 06 21:02:02 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:03 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30" returned: 0 in 0.763s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b99f5b9c-e358-499a-a49a-d040edbd601e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:02:03 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97f4b7d-8d1b-455f-848d-627af6e732fd]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:02:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:03 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e Jul 06 21:02:03 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:03 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7" returned: 0 in 0.737s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:02:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:02:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5690789-3534-478e-957f-35b1708ac139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:02:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f83adc-ae2d-400b-aa02-a731f478f4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:02:03 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Volume volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7 (7ce6aa13-91f4-4ee9-8482-8bbac437d9f7): created successfully Jul 06 21:02:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f83adc-ae2d-400b-aa02-a731f478f4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:02:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Flow 'volume_create_manager' (ec27cfae-5466-4f28-a188-5c22a3467119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:02:03 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-b0165f69-378f-4505-953d-4d368482bb6d tempest-TestServerVolumeAttachmentScenario-634069070 None] Created volume successfully. Jul 06 21:02:03 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e" returned: 0 in 0.839s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:03 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30 Jul 06 21:02:03 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:04 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30" returned: 0 in 0.771s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:04 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30 Jul 06 21:02:04 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:05 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e.6f1e1bf4-556f-4214-91f0-4f2105a2eb30" returned: 0 in 0.851s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] Lock "cinder-quobyte-6f1e1bf4-556f-4214-91f0-4f2105a2eb30" released by "_delete_snapshot" :: held 3.361s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:02:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] Lock "cinder-quobyte-b99f5b9c-e358-499a-a49a-d040edbd601e" released by "delete_snapshot" :: held 3.391s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:02:05 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] Created reservations ['8db92ec0-06c6-45c4-8d90-4116014df6ee', 'e6b1e103-5f79-45ed-9aa5-44fe2cf92c21', '480df611-7f03-4381-ac88-8b0acd2a0872', '415de7a6-8241-453f-b753-2fc1ebb8964b'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:02:05 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] Delete snapshot completed successfully. Jul 06 21:02:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-47100815-0350-4a39-b1b0-d259551530de tempest-SnapshotDependencyTests-1312157360 None] Lock "cinder-6f1e1bf4-556f-4214-91f0-4f2105a2eb30-delete_snapshot" released by "delete_snapshot" :: held 3.555s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:02:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] Acquiring lock "cinder-b99f5b9c-e358-499a-a49a-d040edbd601e-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:02:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] Lock "cinder-b99f5b9c-e358-499a-a49a-d040edbd601e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:02:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] Acquiring lock "cinder-quobyte-b99f5b9c-e358-499a-a49a-d040edbd601e" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:02:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] Lock "cinder-quobyte-b99f5b9c-e358-499a-a49a-d040edbd601e" acquired by "delete_volume" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:02:06 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1edd15a-4c0d-4538-9102-c21b28efac4b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:02:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:06 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e Jul 06 21:02:06 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:07 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e" returned: 0 in 0.826s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:07 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e Jul 06 21:02:07 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:08 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b99f5b9c-e358-499a-a49a-d040edbd601e" returned: 0 in 0.642s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] Lock "cinder-quobyte-b99f5b9c-e358-499a-a49a-d040edbd601e" released by "delete_volume" :: held 1.550s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:02:08 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] Created reservations ['e2eeb0b1-3e8a-48d5-92d9-f89caf40d2e7', '48cc0ee8-b738-41a2-af2e-1a7327ccdb99', '1d6d7cca-ea73-4628-82bf-2b0e69dce94d', '07cb27d9-7c1f-48cc-97ea-403ab46dc7cf'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:02:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:02:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:02:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:02:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:02:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:02:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:08 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:02:08 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] Acquiring lock "cinder-02581971-8946-4a2b-96ed-22ebbcd3f046-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:02:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] Lock "cinder-02581971-8946-4a2b-96ed-22ebbcd3f046-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:02:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] Acquiring lock "cinder-quobyte-02581971-8946-4a2b-96ed-22ebbcd3f046" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:02:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] Lock "cinder-quobyte-02581971-8946-4a2b-96ed-22ebbcd3f046" acquired by "delete_volume" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:02:08 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d81a46b-f017-4dce-8faf-d6c770d307f6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:02:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-02581971-8946-4a2b-96ed-22ebbcd3f046 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:08 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:08 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-02581971-8946-4a2b-96ed-22ebbcd3f046 Jul 06 21:02:08 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.716s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:09 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:02:09 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] Deleted volume successfully. Jul 06 21:02:09 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-21c5bb39-d0cd-444e-94cb-436db793e2e4 tempest-SnapshotDependencyTests-1312157360 None] Lock "cinder-b99f5b9c-e358-499a-a49a-d040edbd601e-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:02:09 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-02581971-8946-4a2b-96ed-22ebbcd3f046" returned: 0 in 0.852s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-02581971-8946-4a2b-96ed-22ebbcd3f046 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:09 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-02581971-8946-4a2b-96ed-22ebbcd3f046 Jul 06 21:02:09 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:10 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-02581971-8946-4a2b-96ed-22ebbcd3f046" returned: 0 in 0.700s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] Lock "cinder-quobyte-02581971-8946-4a2b-96ed-22ebbcd3f046" released by "delete_volume" :: held 1.606s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:02:10 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] Created reservations ['5592645c-65aa-4791-90c8-898cb39291d5', '0eba7ea9-2ea6-40b6-9cda-fb527d51e22d', 'fc060063-fae6-4913-bd37-60e2f2e84a92', '2c5d836b-c599-4c14-a773-a1f7992d5a44'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:02:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:02:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:02:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:02:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:02:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:02:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:10 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:02:10 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:11 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.752s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:11 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:02:11 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] Deleted volume successfully. Jul 06 21:02:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-62429f42-6c7e-4e1b-94b1-babe2bf471e3 tempest-SnapshotDependencyTests-1312157360 None] Lock "cinder-02581971-8946-4a2b-96ed-22ebbcd3f046-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:02:20 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=27,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:02:21 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:UPDATE=36,cinder:INSERT=8,cinder:SELECT=28,cinder:DELETE=4 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:02:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-85983230-d808-4800-90b7-b2d87fd97d2d req-540658bc-8991-4e73-91d9-033ca654c8b7 tempest-TestServerVolumeAttachmentScenario-634069070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:02:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-85983230-d808-4800-90b7-b2d87fd97d2d req-540658bc-8991-4e73-91d9-033ca654c8b7 tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:02:34 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd866e6-2662-4fc7-b923-36f7f916cfcc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:02:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-85983230-d808-4800-90b7-b2d87fd97d2d req-540658bc-8991-4e73-91d9-033ca654c8b7 tempest-TestServerVolumeAttachmentScenario-634069070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-532cf499-239e-48ba-a72c-c004b8fa4308 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:34 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-532cf499-239e-48ba-a72c-c004b8fa4308 Jul 06 21:02:34 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:35 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-85983230-d808-4800-90b7-b2d87fd97d2d req-540658bc-8991-4e73-91d9-033ca654c8b7 tempest-TestServerVolumeAttachmentScenario-634069070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-532cf499-239e-48ba-a72c-c004b8fa4308" returned: 0 in 0.853s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-85983230-d808-4800-90b7-b2d87fd97d2d req-540658bc-8991-4e73-91d9-033ca654c8b7 tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.871s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:02:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-85983230-d808-4800-90b7-b2d87fd97d2d req-540658bc-8991-4e73-91d9-033ca654c8b7 tempest-TestServerVolumeAttachmentScenario-634069070 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-532cf499-239e-48ba-a72c-c004b8fa4308', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '484ec9c6-7201-4ccd-b08a-19d7c861799b', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:02:35 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-85983230-d808-4800-90b7-b2d87fd97d2d req-540658bc-8991-4e73-91d9-033ca654c8b7 tempest-TestServerVolumeAttachmentScenario-634069070 None] attachment_update completed successfully. Jul 06 21:02:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-e8fb3fd0-0a0b-4d01-8d72-6fa7132c3578 req-8d11afad-0b11-4bd4-87ed-0337e6bd66c5 tempest-TestServerVolumeAttachmentScenario-634069070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:02:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-e8fb3fd0-0a0b-4d01-8d72-6fa7132c3578 req-8d11afad-0b11-4bd4-87ed-0337e6bd66c5 tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:02:44 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dafd7d-3589-4a52-b865-b61b4228bcc8]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:02:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-e8fb3fd0-0a0b-4d01-8d72-6fa7132c3578 req-8d11afad-0b11-4bd4-87ed-0337e6bd66c5 tempest-TestServerVolumeAttachmentScenario-634069070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:44 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7 Jul 06 21:02:44 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:44 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-e8fb3fd0-0a0b-4d01-8d72-6fa7132c3578 req-8d11afad-0b11-4bd4-87ed-0337e6bd66c5 tempest-TestServerVolumeAttachmentScenario-634069070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7" returned: 0 in 0.729s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-e8fb3fd0-0a0b-4d01-8d72-6fa7132c3578 req-8d11afad-0b11-4bd4-87ed-0337e6bd66c5 tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.751s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:02:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-e8fb3fd0-0a0b-4d01-8d72-6fa7132c3578 req-8d11afad-0b11-4bd4-87ed-0337e6bd66c5 tempest-TestServerVolumeAttachmentScenario-634069070 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfaefbfd-aa24-407b-8e11-3edbfa952872', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:02:44 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-e8fb3fd0-0a0b-4d01-8d72-6fa7132c3578 req-8d11afad-0b11-4bd4-87ed-0337e6bd66c5 tempest-TestServerVolumeAttachmentScenario-634069070 None] attachment_update completed successfully. Jul 06 21:02:50 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-855932c1-69be-42a9-9a2e-90398461d836 req-a6896b58-6613-4378-b2f8-936c82ed9b40 tempest-TestServerVolumeAttachmentScenario-634069070 None] Terminate volume connection completed successfully. Jul 06 21:02:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-855932c1-69be-42a9-9a2e-90398461d836 req-a6896b58-6613-4378-b2f8-936c82ed9b40 tempest-TestServerVolumeAttachmentScenario-634069070 None] Deleting attachment dfaefbfd-aa24-407b-8e11-3edbfa952872. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:02:54 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-67ec353e-19e5-4b99-ae24-62cdec6c2449 req-76a1a71f-e2e3-428f-a196-e0b34602874a tempest-TestServerVolumeAttachmentScenario-634069070 None] Terminate volume connection completed successfully. Jul 06 21:02:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-67ec353e-19e5-4b99-ae24-62cdec6c2449 req-76a1a71f-e2e3-428f-a196-e0b34602874a tempest-TestServerVolumeAttachmentScenario-634069070 None] Deleting attachment 484ec9c6-7201-4ccd-b08a-19d7c861799b. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:02:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:02:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:02:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:02:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:02:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:02:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:02:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:58 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:02:58 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:58 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.767s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:02:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:02:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:02:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:03:04 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=15,cinder:UPDATE=3 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:03:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] Acquiring lock "cinder-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:03:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "cinder-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:03:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] Acquiring lock "cinder-quobyte-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:03:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "cinder-quobyte-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7" acquired by "delete_volume" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:03:04 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[074901c0-7d87-4316-bcb2-17e7b8cfb6dc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:03:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:04 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7 Jul 06 21:03:04 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:05 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7" returned: 0 in 0.827s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:05 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7 Jul 06 21:03:05 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:05 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7" returned: 0 in 0.670s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "cinder-quobyte-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7" released by "delete_volume" :: held 1.536s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:03:06 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] Created reservations ['d0309668-e96c-490d-8d24-02fdeb0a0e34', '54582530-2711-4007-aad4-51c04d600a2c', 'b38e509b-d317-4ab6-932a-4fd18cabb461', '73fa981b-569d-4ef2-95b3-c6812517f059'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:03:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:03:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:03:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:03:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:03:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:03:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:06 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:03:06 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] Acquiring lock "cinder-532cf499-239e-48ba-a72c-c004b8fa4308-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:03:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "cinder-532cf499-239e-48ba-a72c-c004b8fa4308-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:03:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] Acquiring lock "cinder-quobyte-532cf499-239e-48ba-a72c-c004b8fa4308" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:03:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "cinder-quobyte-532cf499-239e-48ba-a72c-c004b8fa4308" acquired by "delete_volume" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:03:06 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d62b0ce-53d4-4ac1-99ad-abfe19d29fee]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:03:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-532cf499-239e-48ba-a72c-c004b8fa4308 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:06 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.734s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:06 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:03:06 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] Deleted volume successfully. Jul 06 21:03:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cd172ed0-5c5b-478e-bb9d-84287263a800 tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "cinder-7ce6aa13-91f4-4ee9-8482-8bbac437d9f7-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:03:06 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-532cf499-239e-48ba-a72c-c004b8fa4308 Jul 06 21:03:06 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:07 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-532cf499-239e-48ba-a72c-c004b8fa4308" returned: 0 in 0.766s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-532cf499-239e-48ba-a72c-c004b8fa4308 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:07 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-532cf499-239e-48ba-a72c-c004b8fa4308 Jul 06 21:03:07 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:08 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-532cf499-239e-48ba-a72c-c004b8fa4308" returned: 0 in 0.645s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "cinder-quobyte-532cf499-239e-48ba-a72c-c004b8fa4308" released by "delete_volume" :: held 1.455s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:03:08 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] Created reservations ['c59424e0-ff57-4145-9c77-f1c25129d296', '824e6d7a-6dfd-496e-968f-540dca9d0877', '33123c89-ff02-4010-80a7-b872d9e1686d', 'f739d234-0502-470b-bc2c-c3dad5437911'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:03:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:03:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:03:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:03:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:03:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:03:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:08 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:03:08 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:08 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.697s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:08 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:03:08 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] Deleted volume successfully. Jul 06 21:03:09 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8c05888a-00d6-4922-b8eb-5512097cf44d tempest-TestServerVolumeAttachmentScenario-634069070 None] Lock "cinder-532cf499-239e-48ba-a72c-c004b8fa4308-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:03:18 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=10,cinder:INSERT=5,cinder:UPDATE=17 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:03:19 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=22,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:03:40 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:03:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Flow 'volume_create_manager' (39b085b4-5bde-4338-b370-9af52c75398c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:03:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134aff80-11d9-4607-b342-0f413b6f8702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:03:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134aff80-11d9-4607-b342-0f413b6f8702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-325533034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc861dc-6542-4118-920f-87c23034a503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be21a5022210481ca4010affdd09ed32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:03:40Z,use_quota=True,user_id='96673509853a41c3aefaf59cd3e0a4ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:03:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287e2614-fb10-4f13-9dd3-d06446fa8f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:03:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287e2614-fb10-4f13-9dd3-d06446fa8f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:03:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23963f4-c827-4530-92c6-d0a222e75789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:03:40 devstack cinder-volume[87207]: DEBUG cinder.image.glance [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Creating Keystone auth plugin from conf {{(pid=87207) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 21:03:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23963f4-c827-4530-92c6-d0a222e75789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cbc861dc-6542-4118-920f-87c23034a503', 'volume_name': 'volume-cbc861dc-6542-4118-920f-87c23034a503', 'volume_size': 1, 'image_id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6600b41119584a67ac9b8504a63b23ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:03:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ffeb73-6e26-4c14-a16a-7624cdb9eb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:03:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ffeb73-6e26-4c14-a16a-7624cdb9eb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:03:40 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3c0275-b999-4d25-9a97-dd2967de6260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:03:40 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Volume cbc861dc-6542-4118-920f-87c23034a503: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cbc861dc-6542-4118-920f-87c23034a503', 'volume_size': 1, 'image_id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6600b41119584a67ac9b8504a63b23ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 21:03:40 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Trying to clone cbc861dc-6542-4118-920f-87c23034a503 from image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d at location (None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}]). {{(pid=87207) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 21:03:41 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_85j6xiazdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 21:03:41 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Image download 20.69 MB at 20.69 MB/s Jul 06 21:03:41 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3659306-ebe4-40e2-b6c8-5c436c961171]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:03:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_85j6xiazdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:41 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_85j6xiazdevstack@QuobyteHD Jul 06 21:03:41 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:41 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_85j6xiazdevstack@QuobyteHD" returned: 0 in 0.705s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:41 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Temporary image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d is fetched for user 96673509853a41c3aefaf59cd3e0a4ae. {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 21:03:41 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88fc40d-9c3a-45a6-9db0-acc84e66e55f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:03:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_85j6xiazdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:42 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_85j6xiazdevstack@QuobyteHD Jul 06 21:03:42 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:42 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_85j6xiazdevstack@QuobyteHD" returned: 0 in 0.688s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:03:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:03:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-325533034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc861dc-6542-4118-920f-87c23034a503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be21a5022210481ca4010affdd09ed32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:03:40Z,use_quota=True,user_id='96673509853a41c3aefaf59cd3e0a4ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:03:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Creating volume cbc861dc-6542-4118-920f-87c23034a503 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:03:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:03:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:03:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:03:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:03:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:03:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:03:42 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:03:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:42 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 1073741824 Jul 06 21:03:42 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:43 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 1073741824" returned: 0 in 0.811s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:43 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 Jul 06 21:03:43 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:44 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503" returned: 0 in 0.637s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:03:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:03:44 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Attempting download of 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d ((None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}])) to volume cbc861dc-6542-4118-920f-87c23034a503. {{(pid=87207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 21:03:44 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3311451-0b8e-44d6-b6ef-cf2f8ecb9479]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:03:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_7zni5cby {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:44 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_7zni5cby Jul 06 21:03:44 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:44 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_7zni5cby" returned: 0 in 0.745s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_7zni5cby {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:45 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_7zni5cby Jul 06 21:03:45 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:45 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_7zni5cby" returned: 1 in 0.712s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_7zni5cby' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:03:45 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0c6cf8-5865-4bad-8ed8-33784849d019]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:03:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_85j6xiazdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:45 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_85j6xiazdevstack@QuobyteHD Jul 06 21:03:45 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:46 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_85j6xiazdevstack@QuobyteHD" returned: 0 in 0.678s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:46 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d was qcow2, converting to raw {{(pid=87207) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 21:03:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_85j6xiazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:46 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_85j6xiazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 Jul 06 21:03:46 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:48 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_85j6xiazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503" returned: 0 in 1.775s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:48 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5552fa6f-beb5-4d69-a850-58dd0ecf7f1d_85j6xiazdevstack@QuobyteHD, size 112.00 MB, duration 1.78 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:03:48 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Converted 112.00 MB image at 63.06 MB/s Jul 06 21:03:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:48 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 1G Jul 06 21:03:48 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:48 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 1G" returned: 0 in 0.671s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:48 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e664285e-59fe-49bd-a8d5-625bb28f1b29]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:03:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:48 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 Jul 06 21:03:48 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:49 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503" returned: 0 in 0.710s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:49 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 Jul 06 21:03:49 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:50 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503" returned: 1 in 0.735s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:03:50 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Downloaded image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d ((None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}])) to volume cbc861dc-6542-4118-920f-87c23034a503 successfully. {{(pid=87207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 21:03:50 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Temporary image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d for user 96673509853a41c3aefaf59cd3e0a4ae is deleted. {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 21:03:50 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Marking volume cbc861dc-6542-4118-920f-87c23034a503 as bootable. {{(pid=87207) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 21:03:50 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Copying metadata from image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d to cbc861dc-6542-4118-920f-87c23034a503. {{(pid=87207) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 21:03:50 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Creating volume glance metadata for volume cbc861dc-6542-4118-920f-87c23034a503 backed by image 5552fa6f-beb5-4d69-a850-58dd0ecf7f1d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87207) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 21:03:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3c0275-b999-4d25-9a97-dd2967de6260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbc861dc-6542-4118-920f-87c23034a503', 'volume_size': 1, 'image_id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6600b41119584a67ac9b8504a63b23ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5552fa6f-beb5-4d69-a850-58dd0ecf7f1d', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5552fa6f-beb5-4d69-a850-58dd0ecf7f1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:03:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afd6549-db70-42c2-98ea-0ef8f6a1bf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:03:50 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Volume volume-cbc861dc-6542-4118-920f-87c23034a503 (cbc861dc-6542-4118-920f-87c23034a503): created successfully Jul 06 21:03:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afd6549-db70-42c2-98ea-0ef8f6a1bf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:03:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Flow 'volume_create_manager' (39b085b4-5bde-4338-b370-9af52c75398c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:03:50 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0a91b1ec-24e4-4432-b5a6-2e796e1e58c5 tempest-TestShelveInstance-214932219 None] Created volume successfully. Jul 06 21:03:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-c8fcdfe2-7c25-42d4-a471-0d52cc1feb13 req-7b1eafe7-ae37-4bdf-afda-d3b3dcfc10f1 tempest-TestShelveInstance-214932219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:03:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-c8fcdfe2-7c25-42d4-a471-0d52cc1feb13 req-7b1eafe7-ae37-4bdf-afda-d3b3dcfc10f1 tempest-TestShelveInstance-214932219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:03:57 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eea9d61-184f-4cb3-ad94-bad1dc2a1a37]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:03:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-c8fcdfe2-7c25-42d4-a471-0d52cc1feb13 req-7b1eafe7-ae37-4bdf-afda-d3b3dcfc10f1 tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:03:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:03:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:03:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:03:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:03:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:03:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:58 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:03:58 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:58 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 Jul 06 21:03:58 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:58 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.694s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:03:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:03:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:03:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:03:58 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-c8fcdfe2-7c25-42d4-a471-0d52cc1feb13 req-7b1eafe7-ae37-4bdf-afda-d3b3dcfc10f1 tempest-TestShelveInstance-214932219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503" returned: 0 in 0.831s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-c8fcdfe2-7c25-42d4-a471-0d52cc1feb13 req-7b1eafe7-ae37-4bdf-afda-d3b3dcfc10f1 tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:58 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 Jul 06 21:03:58 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:59 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-c8fcdfe2-7c25-42d4-a471-0d52cc1feb13 req-7b1eafe7-ae37-4bdf-afda-d3b3dcfc10f1 tempest-TestShelveInstance-214932219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503" returned: 1 in 0.724s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-c8fcdfe2-7c25-42d4-a471-0d52cc1feb13 req-7b1eafe7-ae37-4bdf-afda-d3b3dcfc10f1 tempest-TestShelveInstance-214932219 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:03:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-c8fcdfe2-7c25-42d4-a471-0d52cc1feb13 req-7b1eafe7-ae37-4bdf-afda-d3b3dcfc10f1 tempest-TestShelveInstance-214932219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.598s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:03:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-c8fcdfe2-7c25-42d4-a471-0d52cc1feb13 req-7b1eafe7-ae37-4bdf-afda-d3b3dcfc10f1 tempest-TestShelveInstance-214932219 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-cbc861dc-6542-4118-920f-87c23034a503', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f2bd51a-fab0-4d7f-be44-938b89171e7e', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:03:59 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-c8fcdfe2-7c25-42d4-a471-0d52cc1feb13 req-7b1eafe7-ae37-4bdf-afda-d3b3dcfc10f1 tempest-TestShelveInstance-214932219 None] attachment_update completed successfully. Jul 06 21:04:09 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=17,cinder:INSERT=5,cinder:UPDATE=8 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:04:09 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:UPDATE=4,cinder:SELECT=13,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:04:36 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-f881fe52-5bf7-43ca-b446-95abf09d3f12 req-808abe8c-8379-4ec6-898b-a51fe7320b60 tempest-TestShelveInstance-214932219 None] Terminate volume connection completed successfully. Jul 06 21:04:36 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-f881fe52-5bf7-43ca-b446-95abf09d3f12 req-808abe8c-8379-4ec6-898b-a51fe7320b60 tempest-TestShelveInstance-214932219 None] Deleting attachment 3f2bd51a-fab0-4d7f-be44-938b89171e7e. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:04:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-8a1977ef-ca59-41a4-a84b-e8e7e0d95b81 req-83cee93a-0821-4abe-832b-3f37445b8f71 tempest-TestShelveInstance-214932219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:04:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-8a1977ef-ca59-41a4-a84b-e8e7e0d95b81 req-83cee93a-0821-4abe-832b-3f37445b8f71 tempest-TestShelveInstance-214932219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:04:41 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed3c721-1765-40cc-8165-43a7d5f91489]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:04:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-8a1977ef-ca59-41a4-a84b-e8e7e0d95b81 req-83cee93a-0821-4abe-832b-3f37445b8f71 tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:04:41 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 Jul 06 21:04:41 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:04:42 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Jul 06 21:04:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-8a1977ef-ca59-41a4-a84b-e8e7e0d95b81 req-83cee93a-0821-4abe-832b-3f37445b8f71 tempest-TestShelveInstance-214932219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503" returned: 0 in 0.774s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:04:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-8a1977ef-ca59-41a4-a84b-e8e7e0d95b81 req-83cee93a-0821-4abe-832b-3f37445b8f71 tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:04:42 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 Jul 06 21:04:42 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:04:43 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Jul 06 21:04:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-8a1977ef-ca59-41a4-a84b-e8e7e0d95b81 req-83cee93a-0821-4abe-832b-3f37445b8f71 tempest-TestShelveInstance-214932219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503" returned: 1 in 0.787s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:04:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-8a1977ef-ca59-41a4-a84b-e8e7e0d95b81 req-83cee93a-0821-4abe-832b-3f37445b8f71 tempest-TestShelveInstance-214932219 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:04:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-8a1977ef-ca59-41a4-a84b-e8e7e0d95b81 req-83cee93a-0821-4abe-832b-3f37445b8f71 tempest-TestShelveInstance-214932219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.607s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:04:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-8a1977ef-ca59-41a4-a84b-e8e7e0d95b81 req-83cee93a-0821-4abe-832b-3f37445b8f71 tempest-TestShelveInstance-214932219 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-cbc861dc-6542-4118-920f-87c23034a503', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '160d83fc-3b8e-4b20-a7c0-af207648bebb', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:04:43 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-8a1977ef-ca59-41a4-a84b-e8e7e0d95b81 req-83cee93a-0821-4abe-832b-3f37445b8f71 tempest-TestShelveInstance-214932219 None] attachment_update completed successfully. Jul 06 21:04:53 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=8 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:04:53 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:04:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:04:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:04:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:04:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:04:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:04:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:04:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:04:58 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:04:58 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:04:58 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Jul 06 21:04:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.665s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:04:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:04:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:04:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:04:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:05:12 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:05:12 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:UPDATE=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:05:22 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-fe99a884-37ad-4cf1-8b20-93189d63ae2f tempest-TestShelveInstance-214932219 None] Terminate volume connection completed successfully. Jul 06 21:05:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-fe99a884-37ad-4cf1-8b20-93189d63ae2f tempest-TestShelveInstance-214932219 None] Deleting attachment 160d83fc-3b8e-4b20-a7c0-af207648bebb. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:05:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] Acquiring lock "cinder-cbc861dc-6542-4118-920f-87c23034a503-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] Lock "cinder-cbc861dc-6542-4118-920f-87c23034a503-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] Acquiring lock "cinder-quobyte-cbc861dc-6542-4118-920f-87c23034a503" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] Lock "cinder-quobyte-cbc861dc-6542-4118-920f-87c23034a503" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:23 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[56903f18-be69-44ec-ba24-177a7c2d35d8]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:05:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:23 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 Jul 06 21:05:23 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:23 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503" returned: 0 in 0.730s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:23 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 Jul 06 21:05:23 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:24 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503" returned: 1 in 0.714s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:05:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:24 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503 Jul 06 21:05:24 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:25 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cbc861dc-6542-4118-920f-87c23034a503" returned: 0 in 0.680s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:25 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] Lock "cinder-quobyte-cbc861dc-6542-4118-920f-87c23034a503" released by "delete_volume" :: held 2.194s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:25 devstack cinder-volume[87207]: DEBUG cinder.quota [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] Created reservations ['83ac4b31-4e33-466a-8db2-79f92f246cc7', '41ff8e99-ae24-4412-bde9-a27b2f645dc4', '84106550-bc6c-48f2-a089-b86939ba9e1a', '3efd80d7-e7c1-4f05-aecb-1ceb01af058c'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:05:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:05:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:05:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:25 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:05:25 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:26 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.691s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:26 devstack cinder-volume[87207]: DEBUG cinder.manager [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:05:26 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] Deleted volume successfully. Jul 06 21:05:26 devstack cinder-volume[87207]: DEBUG cinder.coordination [req-27ab3462-a9f7-4173-a577-81844ebc9a5c req-7e56206d-1594-4920-86d0-253af389623f tempest-TestShelveInstance-214932219 None] Lock "cinder-cbc861dc-6542-4118-920f-87c23034a503-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:35 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:05:36 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:05:57 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:05:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Flow 'volume_create_manager' (16f62d03-267e-445b-a6e0-9cc712a2634c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:05:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2820bbff-0f0f-4ed0-a97d-8d231799061e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:57 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2820bbff-0f0f-4ed0-a97d-8d231799061e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-368981514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53187c61-68d8-4811-ad3c-5a65592a1253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82c93949013438a9d4cc84b67948f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:58Z,use_quota=True,user_id='56feb58321cf4ec2afaa24134b493407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2c32eb-3abd-4ab3-a664-65db0405585d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2c32eb-3abd-4ab3-a664-65db0405585d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09826033-ae04-4ef2-9d89-dff6fe1d87d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09826033-ae04-4ef2-9d89-dff6fe1d87d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53187c61-68d8-4811-ad3c-5a65592a1253', 'volume_name': 'volume-53187c61-68d8-4811-ad3c-5a65592a1253', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6db3266-10e6-4354-bf21-063d7851c891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6db3266-10e6-4354-bf21-063d7851c891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a67a9b-e1ef-4bae-a9c4-fd0bda52eb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:58 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Volume 53187c61-68d8-4811-ad3c-5a65592a1253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53187c61-68d8-4811-ad3c-5a65592a1253', 'volume_size': 1} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-368981514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53187c61-68d8-4811-ad3c-5a65592a1253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82c93949013438a9d4cc84b67948f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:58Z,use_quota=True,user_id='56feb58321cf4ec2afaa24134b493407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Creating volume 53187c61-68d8-4811-ad3c-5a65592a1253 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:05:58 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:58 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 1073741824 Jul 06 21:05:58 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:58 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:05:58 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:58 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.683s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:05:58 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 1073741824" returned: 0 in 0.938s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:59 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 Jul 06 21:05:59 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:59 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253" returned: 0 in 0.639s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:05:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a67a9b-e1ef-4bae-a9c4-fd0bda52eb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53187c61-68d8-4811-ad3c-5a65592a1253', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906dac31-c863-4705-9dd5-619665b0903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:59 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Volume volume-53187c61-68d8-4811-ad3c-5a65592a1253 (53187c61-68d8-4811-ad3c-5a65592a1253): created successfully Jul 06 21:05:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906dac31-c863-4705-9dd5-619665b0903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Flow 'volume_create_manager' (16f62d03-267e-445b-a6e0-9cc712a2634c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:05:59 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-dfda4a3e-c2c5-4980-be93-6e77bb1d6b78 tempest-TestStampPattern-1141351737 None] Created volume successfully. Jul 06 21:06:09 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:06:09 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:06:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-5f21db5c-19e5-4660-8b3b-da5d7869f2c0 req-6c7e3cdc-03f8-4fcf-8ca6-53fec78a1456 tempest-TestStampPattern-1141351737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-5f21db5c-19e5-4660-8b3b-da5d7869f2c0 req-6c7e3cdc-03f8-4fcf-8ca6-53fec78a1456 tempest-TestStampPattern-1141351737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:38 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa226037-559d-4e2f-a51f-6bd3978c1187]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-5f21db5c-19e5-4660-8b3b-da5d7869f2c0 req-6c7e3cdc-03f8-4fcf-8ca6-53fec78a1456 tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:38 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 Jul 06 21:06:38 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:38 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-5f21db5c-19e5-4660-8b3b-da5d7869f2c0 req-6c7e3cdc-03f8-4fcf-8ca6-53fec78a1456 tempest-TestStampPattern-1141351737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253" returned: 0 in 0.729s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-5f21db5c-19e5-4660-8b3b-da5d7869f2c0 req-6c7e3cdc-03f8-4fcf-8ca6-53fec78a1456 tempest-TestStampPattern-1141351737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.746s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:38 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-5f21db5c-19e5-4660-8b3b-da5d7869f2c0 req-6c7e3cdc-03f8-4fcf-8ca6-53fec78a1456 tempest-TestStampPattern-1141351737 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-53187c61-68d8-4811-ad3c-5a65592a1253', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e89471d7-1422-48a2-b13a-6a8859ae0c17', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:06:38 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-5f21db5c-19e5-4660-8b3b-da5d7869f2c0 req-6c7e3cdc-03f8-4fcf-8ca6-53fec78a1456 tempest-TestStampPattern-1141351737 None] attachment_update completed successfully. Jul 06 21:06:47 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-04dfef13-55df-4418-a1d4-3a77e06d8d9d req-c5318d2b-1fb7-4765-8d37-1bec519244f1 tempest-TestStampPattern-1141351737 None] Terminate volume connection completed successfully. Jul 06 21:06:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-04dfef13-55df-4418-a1d4-3a77e06d8d9d req-c5318d2b-1fb7-4765-8d37-1bec519244f1 tempest-TestStampPattern-1141351737 None] Deleting attachment e89471d7-1422-48a2-b13a-6a8859ae0c17. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:06:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] Creating offline snapshot 73dd38d3-2161-4797-a338-3813ed234fb1 of volume 53187c61-68d8-4811-ad3c-5a65592a1253 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:06:49 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2de60ce-8818-4e5f-8b00-b3bef68a1ee0]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:49 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 Jul 06 21:06:49 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:49 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253" returned: 0 in 0.722s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:50 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1 1G Jul 06 21:06:50 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:50 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1 1G" returned: 0 in 0.799s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53187c61-68d8-4811-ad3c-5a65592a1253 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:50 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53187c61-68d8-4811-ad3c-5a65592a1253 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1 Jul 06 21:06:50 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:51 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53187c61-68d8-4811-ad3c-5a65592a1253 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1" returned: 0 in 0.654s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:51 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1 is being set with open permissions: ugo+rw Jul 06 21:06:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:51 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1 Jul 06 21:06:51 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:52 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1" returned: 0 in 0.613s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:52 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.info Jul 06 21:06:52 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:52 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.info" returned: 0 in 0.615s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:52 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.info is being set with open permissions: ugo+rw Jul 06 21:06:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:52 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.info Jul 06 21:06:52 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:53 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.info" returned: 0 in 0.670s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.149s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:53 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-66d41b7c-d3e3-458f-9fbd-2753fab6fb04 tempest-TestStampPattern-1141351737 None] Create snapshot completed successfully Jul 06 21:06:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:06:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:06:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:06:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:58 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:06:58 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:58 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.626s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:06:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:06:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:06:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Flow 'volume_create_manager' (d5b0f8f4-a65e-45b0-8b20-ad106d33d363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d516ca-2a57-4d71-8d4e-ae200b34c3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d516ca-2a57-4d71-8d4e-ae200b34c3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-19189077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66053832-e7c7-4110-bda2-86c1a342b8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82c93949013438a9d4cc84b67948f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=73dd38d3-2161-4797-a338-3813ed234fb1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:07:04Z,use_quota=True,user_id='56feb58321cf4ec2afaa24134b493407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea4d48f-2a6b-45df-86ee-759af382f35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea4d48f-2a6b-45df-86ee-759af382f35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (883301e3-2572-45cd-a00b-846813c5254b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (883301e3-2572-45cd-a00b-846813c5254b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '66053832-e7c7-4110-bda2-86c1a342b8ee', 'volume_name': 'volume-66053832-e7c7-4110-bda2-86c1a342b8ee', 'volume_size': 1, 'snapshot_id': '73dd38d3-2161-4797-a338-3813ed234fb1'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171afaf4-32c1-499f-bae3-60c2339630a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171afaf4-32c1-499f-bae3-60c2339630a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a981bc5-3560-4eb8-a977-f25e4c18983e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:04 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Volume 66053832-e7c7-4110-bda2-86c1a342b8ee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-66053832-e7c7-4110-bda2-86c1a342b8ee', 'volume_size': 1, 'snapshot_id': '73dd38d3-2161-4797-a338-3813ed234fb1'} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Acquiring lock "cinder-quobyte-73dd38d3-2161-4797-a338-3813ed234fb1-66053832-e7c7-4110-bda2-86c1a342b8ee" by "_create_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Lock "cinder-quobyte-73dd38d3-2161-4797-a338-3813ed234fb1-66053832-e7c7-4110-bda2-86c1a342b8ee" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Creating volume 66053832-e7c7-4110-bda2-86c1a342b8ee from snapshot 73dd38d3-2161-4797-a338-3813ed234fb1 {{(pid=87207) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Acquiring lock "cinder-quobyte-66053832-e7c7-4110-bda2-86c1a342b8ee" by "_copy_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Lock "cinder-quobyte-66053832-e7c7-4110-bda2-86c1a342b8ee" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] snapshot: 73dd38d3-2161-4797-a338-3813ed234fb1, volume: 66053832-e7c7-4110-bda2-86c1a342b8ee, {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a0f11f-7edf-4fe3-82a3-d73a51e4e91a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:04 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1 Jul 06 21:07:04 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:05 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1" returned: 0 in 0.772s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53187c61-68d8-4811-ad3c-5a65592a1253(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:07:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 21:07:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Creating direct copy from snapshot {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 21:07:05 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdf4a3d-5fe0-41b0-9fb0-aadd81682a49]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:05 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 Jul 06 21:07:05 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:05 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253" returned: 0 in 0.750s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:05 devstack cinder-volume[87207]: DEBUG cinder.utils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Path /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-66053832-e7c7-4110-bda2-86c1a342b8ee not found in is_blk_device check {{(pid=87207) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 21:07:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-66053832-e7c7-4110-bda2-86c1a342b8ee {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:05 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-66053832-e7c7-4110-bda2-86c1a342b8ee Jul 06 21:07:05 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:10 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-66053832-e7c7-4110-bda2-86c1a342b8ee" returned: 0 in 4.485s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:10 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f5725c-823b-460e-b082-0a63f41eef31]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:10 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 Jul 06 21:07:10 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:11 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253" returned: 0 in 0.979s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:11 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Image conversion details: src /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253, size 1024.00 MB, duration 4.49 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-66053832-e7c7-4110-bda2-86c1a342b8ee {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:07:11 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Converted 1024.00 MB image at 228.24 MB/s Jul 06 21:07:11 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-66053832-e7c7-4110-bda2-86c1a342b8ee is being set with open permissions: ugo+rw Jul 06 21:07:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-66053832-e7c7-4110-bda2-86c1a342b8ee {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:11 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-66053832-e7c7-4110-bda2-86c1a342b8ee Jul 06 21:07:11 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:11 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-66053832-e7c7-4110-bda2-86c1a342b8ee" returned: 0 in 0.675s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Lock "cinder-quobyte-66053832-e7c7-4110-bda2-86c1a342b8ee" released by "_copy_volume_from_snapshot" :: held 7.762s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Lock "cinder-quobyte-73dd38d3-2161-4797-a338-3813ed234fb1-66053832-e7c7-4110-bda2-86c1a342b8ee" released by "_create_volume_from_snapshot" :: held 7.795s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.811s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a981bc5-3560-4eb8-a977-f25e4c18983e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66053832-e7c7-4110-bda2-86c1a342b8ee', 'volume_size': 1, 'snapshot_id': '73dd38d3-2161-4797-a338-3813ed234fb1'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2459419-c120-422f-9c55-befe52caed19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:12 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Volume volume-66053832-e7c7-4110-bda2-86c1a342b8ee (66053832-e7c7-4110-bda2-86c1a342b8ee): created successfully Jul 06 21:07:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2459419-c120-422f-9c55-befe52caed19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Flow 'volume_create_manager' (d5b0f8f4-a65e-45b0-8b20-ad106d33d363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:07:12 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f38453df-048a-4204-ba0b-a4ea0f009f02 tempest-TestStampPattern-1141351737 None] Created volume successfully. Jul 06 21:07:22 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=18,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:07:22 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:07:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:07:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:07:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:07:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:58 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:07:58 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:58 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.669s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:07:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:07:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:07:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:08:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-74eedd78-ce9b-4dd9-9781-6c4b1f43e5f5 req-93f92beb-5766-4998-b2a0-e0bfeb81be2e tempest-TestStampPattern-1141351737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-74eedd78-ce9b-4dd9-9781-6c4b1f43e5f5 req-93f92beb-5766-4998-b2a0-e0bfeb81be2e tempest-TestStampPattern-1141351737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:01 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8405ef1-595f-47a5-9dc0-3ba38b1d9017]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:08:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-74eedd78-ce9b-4dd9-9781-6c4b1f43e5f5 req-93f92beb-5766-4998-b2a0-e0bfeb81be2e tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-66053832-e7c7-4110-bda2-86c1a342b8ee {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:01 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-66053832-e7c7-4110-bda2-86c1a342b8ee Jul 06 21:08:01 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:02 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [req-74eedd78-ce9b-4dd9-9781-6c4b1f43e5f5 req-93f92beb-5766-4998-b2a0-e0bfeb81be2e tempest-TestStampPattern-1141351737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-66053832-e7c7-4110-bda2-86c1a342b8ee" returned: 0 in 0.844s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [req-74eedd78-ce9b-4dd9-9781-6c4b1f43e5f5 req-93f92beb-5766-4998-b2a0-e0bfeb81be2e tempest-TestStampPattern-1141351737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.865s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:02 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-74eedd78-ce9b-4dd9-9781-6c4b1f43e5f5 req-93f92beb-5766-4998-b2a0-e0bfeb81be2e tempest-TestStampPattern-1141351737 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15', 'name': 'volume-66053832-e7c7-4110-bda2-86c1a342b8ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94755c9f-d94a-4e2c-8fca-f5418235afba', 'enforce_multipath': True} {{(pid=87207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:08:02 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-74eedd78-ce9b-4dd9-9781-6c4b1f43e5f5 req-93f92beb-5766-4998-b2a0-e0bfeb81be2e tempest-TestStampPattern-1141351737 None] attachment_update completed successfully. Jul 06 21:08:08 devstack cinder-volume[87207]: INFO cinder.volume.manager [req-9ddca56e-6987-48ec-aad6-63e98be9af36 req-df1afd2f-3232-475e-b148-fef250b1f605 tempest-TestStampPattern-1141351737 None] Terminate volume connection completed successfully. Jul 06 21:08:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [req-9ddca56e-6987-48ec-aad6-63e98be9af36 req-df1afd2f-3232-475e-b148-fef250b1f605 tempest-TestStampPattern-1141351737 None] Deleting attachment 94755c9f-d94a-4e2c-8fca-f5418235afba. {{(pid=87207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:08:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] Acquiring lock "cinder-66053832-e7c7-4110-bda2-86c1a342b8ee-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] Lock "cinder-66053832-e7c7-4110-bda2-86c1a342b8ee-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] Acquiring lock "cinder-quobyte-66053832-e7c7-4110-bda2-86c1a342b8ee" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] Lock "cinder-quobyte-66053832-e7c7-4110-bda2-86c1a342b8ee" acquired by "delete_volume" :: waited 0.012s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:17 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7b9f38-554c-4b16-af18-5d5a4f6add05]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:08:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-66053832-e7c7-4110-bda2-86c1a342b8ee {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:17 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-66053832-e7c7-4110-bda2-86c1a342b8ee Jul 06 21:08:17 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:18 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-66053832-e7c7-4110-bda2-86c1a342b8ee" returned: 0 in 0.743s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-66053832-e7c7-4110-bda2-86c1a342b8ee {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:18 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-66053832-e7c7-4110-bda2-86c1a342b8ee Jul 06 21:08:18 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:18 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-66053832-e7c7-4110-bda2-86c1a342b8ee" returned: 0 in 0.641s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] Lock "cinder-quobyte-66053832-e7c7-4110-bda2-86c1a342b8ee" released by "delete_volume" :: held 1.424s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:18 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] Created reservations ['dfbbeb60-b70e-4832-ace0-9872708bbc53', '4b07146a-7276-4086-ad13-740687f437f2', 'eb9ad205-3e76-4a15-8f7a-b2d77ea55ef0', '0194c7de-5305-4f14-bd20-8342adbd158d'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:08:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:18 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:08:18 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:19 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.731s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:19 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:08:19 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] Deleted volume successfully. Jul 06 21:08:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-79da28ee-99d7-42c3-b095-d0b4edd1829e tempest-TestStampPattern-1141351737 None] Lock "cinder-66053832-e7c7-4110-bda2-86c1a342b8ee-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] Acquiring lock "cinder-73dd38d3-2161-4797-a338-3813ed234fb1-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] Lock "cinder-73dd38d3-2161-4797-a338-3813ed234fb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] Acquiring lock "cinder-quobyte-53187c61-68d8-4811-ad3c-5a65592a1253" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] Lock "cinder-quobyte-53187c61-68d8-4811-ad3c-5a65592a1253" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] Acquiring lock "cinder-quobyte-73dd38d3-2161-4797-a338-3813ed234fb1" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] Lock "cinder-quobyte-73dd38d3-2161-4797-a338-3813ed234fb1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:19 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] Deleting offline snapshot 73dd38d3-2161-4797-a338-3813ed234fb1 of volume 53187c61-68d8-4811-ad3c-5a65592a1253 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:08:19 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] snapshot_file for this snap is: volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:08:19 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c46474-b030-4ce4-8cc8-efdd19b89c0a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:08:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:19 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1 Jul 06 21:08:19 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:20 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1" returned: 0 in 0.778s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:20 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53187c61-68d8-4811-ad3c-5a65592a1253(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:08:20 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[09062c6a-5f62-4a32-8fc4-70353feefb55]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:08:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:20 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 Jul 06 21:08:20 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:21 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253" returned: 0 in 0.735s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:21 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1 Jul 06 21:08:21 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:22 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1" returned: 0 in 0.765s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:22 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1 Jul 06 21:08:22 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:22 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253.73dd38d3-2161-4797-a338-3813ed234fb1" returned: 0 in 0.636s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] Lock "cinder-quobyte-73dd38d3-2161-4797-a338-3813ed234fb1" released by "_delete_snapshot" :: held 3.008s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] Lock "cinder-quobyte-53187c61-68d8-4811-ad3c-5a65592a1253" released by "delete_snapshot" :: held 3.030s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:22 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] Created reservations ['74364b7f-5c1e-4a51-8b93-5215db3f275c', '82b4b4bb-4fd2-441e-9495-bae57c55580d', '56c606b1-2213-433a-a96d-5dcec63fe31c', 'e7bdfda7-c485-4d20-bd8c-821c73386a99'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:08:22 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] Delete snapshot completed successfully. Jul 06 21:08:22 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ef7d43e2-6586-46bb-bdd7-611e4e5d7065 tempest-TestStampPattern-1141351737 None] Lock "cinder-73dd38d3-2161-4797-a338-3813ed234fb1-delete_snapshot" released by "delete_snapshot" :: held 3.164s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:31 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] Acquiring lock "cinder-53187c61-68d8-4811-ad3c-5a65592a1253-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:31 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] Lock "cinder-53187c61-68d8-4811-ad3c-5a65592a1253-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:31 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] Acquiring lock "cinder-quobyte-53187c61-68d8-4811-ad3c-5a65592a1253" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:31 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] Lock "cinder-quobyte-53187c61-68d8-4811-ad3c-5a65592a1253" acquired by "delete_volume" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:32 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[310d87cf-5003-46c5-8ec5-495ab8d362d6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:08:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:32 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 Jul 06 21:08:32 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:32 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253" returned: 0 in 0.720s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:32 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253 Jul 06 21:08:32 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:33 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53187c61-68d8-4811-ad3c-5a65592a1253" returned: 0 in 0.620s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] Lock "cinder-quobyte-53187c61-68d8-4811-ad3c-5a65592a1253" released by "delete_volume" :: held 1.392s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:33 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] Created reservations ['cc24a416-b734-41b7-b95b-ec3015413da4', '5a3bf04b-0d9d-4db2-87f5-d070a0701259', 'c19d89b8-1c56-4212-b032-87d5bd327b13', '673d9dc3-146c-499a-89a1-5a0e1e2942c5'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:08:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:33 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:08:33 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:34 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.615s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:34 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:08:34 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] Deleted volume successfully. Jul 06 21:08:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-abe14212-5672-48c2-82ae-5f3c5912defa tempest-TestStampPattern-1141351737 None] Lock "cinder-53187c61-68d8-4811-ad3c-5a65592a1253-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=23,cinder:UPDATE=22,cinder:INSERT=6 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Flow 'volume_create_manager' (4e955e46-7ba9-4dae-9984-22446c232c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced5ebc2-b2ce-4117-b9fd-dd906682d06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced5ebc2-b2ce-4117-b9fd-dd906682d06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1651010374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef74eda9-d796-4a99-8622-2cf61ff25195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c53252f99640929fddf4409548b63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:44Z,use_quota=True,user_id='264c7a9a20674f0e95b903a891672da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb6f6d3-92e1-44bf-9cf3-147cd5e7e1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb6f6d3-92e1-44bf-9cf3-147cd5e7e1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87b4fee-7742-4924-aed4-01d791528870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87b4fee-7742-4924-aed4-01d791528870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef74eda9-d796-4a99-8622-2cf61ff25195', 'volume_name': 'volume-ef74eda9-d796-4a99-8622-2cf61ff25195', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc3cb814-7088-4950-b498-9dfb4c60e18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc3cb814-7088-4950-b498-9dfb4c60e18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03e0c93-4896-4798-ad16-dc5458213d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:43 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Volume ef74eda9-d796-4a99-8622-2cf61ff25195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef74eda9-d796-4a99-8622-2cf61ff25195', 'volume_size': 1} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1651010374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef74eda9-d796-4a99-8622-2cf61ff25195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c53252f99640929fddf4409548b63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:44Z,use_quota=True,user_id='264c7a9a20674f0e95b903a891672da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Creating volume ef74eda9-d796-4a99-8622-2cf61ff25195 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:08:43 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:08:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef74eda9-d796-4a99-8622-2cf61ff25195 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:43 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef74eda9-d796-4a99-8622-2cf61ff25195 1073741824 Jul 06 21:08:43 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:44 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef74eda9-d796-4a99-8622-2cf61ff25195 1073741824" returned: 0 in 0.794s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef74eda9-d796-4a99-8622-2cf61ff25195 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:44 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef74eda9-d796-4a99-8622-2cf61ff25195 Jul 06 21:08:44 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:45 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef74eda9-d796-4a99-8622-2cf61ff25195" returned: 0 in 0.617s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:08:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03e0c93-4896-4798-ad16-dc5458213d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef74eda9-d796-4a99-8622-2cf61ff25195', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beec39a8-b076-4cc7-8ece-bec12d12b42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:45 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Volume volume-ef74eda9-d796-4a99-8622-2cf61ff25195 (ef74eda9-d796-4a99-8622-2cf61ff25195): created successfully Jul 06 21:08:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beec39a8-b076-4cc7-8ece-bec12d12b42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Flow 'volume_create_manager' (4e955e46-7ba9-4dae-9984-22446c232c31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:45 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-623cd962-ab64-4f27-8033-79a0cd13c0ed tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Created volume successfully. Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Flow 'volume_create_manager' (09e0ba2c-411e-4042-8057-aaec488be541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d3ba82-acde-4c01-8093-488241678ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d3ba82-acde-4c01-8093-488241678ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-677177143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00058a0b-821b-4f8d-85e6-825f63da597b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c53252f99640929fddf4409548b63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:46Z,use_quota=True,user_id='264c7a9a20674f0e95b903a891672da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8fd1fe-d7c1-436f-8f70-be1bdf549465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8fd1fe-d7c1-436f-8f70-be1bdf549465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbc9f3d-b987-43ed-bd78-e051ccac0096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbc9f3d-b987-43ed-bd78-e051ccac0096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00058a0b-821b-4f8d-85e6-825f63da597b', 'volume_name': 'volume-00058a0b-821b-4f8d-85e6-825f63da597b', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae85067e-5788-4d70-b57f-3ab2e6f08c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae85067e-5788-4d70-b57f-3ab2e6f08c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1982da99-400d-42e3-a4ee-12e4ec69b32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:46 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Volume 00058a0b-821b-4f8d-85e6-825f63da597b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00058a0b-821b-4f8d-85e6-825f63da597b', 'volume_size': 1} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-677177143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00058a0b-821b-4f8d-85e6-825f63da597b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c53252f99640929fddf4409548b63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:46Z,use_quota=True,user_id='264c7a9a20674f0e95b903a891672da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Creating volume 00058a0b-821b-4f8d-85e6-825f63da597b {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:08:46 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-00058a0b-821b-4f8d-85e6-825f63da597b 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:46 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-00058a0b-821b-4f8d-85e6-825f63da597b 1073741824 Jul 06 21:08:46 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Flow 'volume_create_manager' (4b21e8ab-b488-4f93-a322-acbdf99cf509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa4bade-df33-4293-b146-6e051a8be960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa4bade-df33-4293-b146-6e051a8be960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1128780228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055ca8e4-fd83-4d61-8510-0bcf7156efdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c53252f99640929fddf4409548b63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:47Z,use_quota=True,user_id='264c7a9a20674f0e95b903a891672da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc44bb9-1c43-44ed-8c86-42e7101d07b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc44bb9-1c43-44ed-8c86-42e7101d07b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2481245-6810-49e7-987d-0fff9b6a49e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2481245-6810-49e7-987d-0fff9b6a49e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '055ca8e4-fd83-4d61-8510-0bcf7156efdf', 'volume_name': 'volume-055ca8e4-fd83-4d61-8510-0bcf7156efdf', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4ca21c-e9c0-4e56-9366-8ae2ecadff4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4ca21c-e9c0-4e56-9366-8ae2ecadff4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (583a4269-58d9-40df-b5ef-2f370e7169eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:46 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Volume 055ca8e4-fd83-4d61-8510-0bcf7156efdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-055ca8e4-fd83-4d61-8510-0bcf7156efdf', 'volume_size': 1} Jul 06 21:08:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Flow 'volume_create_manager' (4e125ce3-717a-430b-a65f-81321407b007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9983f1b-a884-4b0b-803d-0d125b66fbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9983f1b-a884-4b0b-803d-0d125b66fbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1564350126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4f31a1-caa0-4410-b714-f31de442edbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c53252f99640929fddf4409548b63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:47Z,use_quota=True,user_id='264c7a9a20674f0e95b903a891672da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f193621c-7afa-40bd-a4fc-8967a4677368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f193621c-7afa-40bd-a4fc-8967a4677368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78adf76e-3abb-4541-b0e2-9998b7316c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78adf76e-3abb-4541-b0e2-9998b7316c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea4f31a1-caa0-4410-b714-f31de442edbb', 'volume_name': 'volume-ea4f31a1-caa0-4410-b714-f31de442edbb', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec8e739-c9da-4864-a6a3-fc5b03876076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec8e739-c9da-4864-a6a3-fc5b03876076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f963ad9-db62-4a50-a000-1a2f7f3c319b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:47 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Volume ea4f31a1-caa0-4410-b714-f31de442edbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea4f31a1-caa0-4410-b714-f31de442edbb', 'volume_size': 1} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:47 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-00058a0b-821b-4f8d-85e6-825f63da597b 1073741824" returned: 0 in 0.972s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Flow 'volume_create_manager' (3d1f74ba-03c2-494f-ba97-5caf9d46581e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba9f2eca-2e41-4c8a-89da-3be8f7fabbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-00058a0b-821b-4f8d-85e6-825f63da597b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba9f2eca-2e41-4c8a-89da-3be8f7fabbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1070108323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced716f5-0a63-41f0-ba6a-30f8f35275d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c53252f99640929fddf4409548b63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:47Z,use_quota=True,user_id='264c7a9a20674f0e95b903a891672da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53196346-bd58-4445-849e-2ac2237d2ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:47 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-00058a0b-821b-4f8d-85e6-825f63da597b Jul 06 21:08:47 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53196346-bd58-4445-849e-2ac2237d2ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae373b6d-f6ff-4576-a14e-91ee1b15d73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae373b6d-f6ff-4576-a14e-91ee1b15d73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced716f5-0a63-41f0-ba6a-30f8f35275d3', 'volume_name': 'volume-ced716f5-0a63-41f0-ba6a-30f8f35275d3', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84220745-4457-4cdc-b6be-e393e97bbbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84220745-4457-4cdc-b6be-e393e97bbbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2eea177-abd9-4285-b5f4-6fbcf128cbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:47 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Volume ced716f5-0a63-41f0-ba6a-30f8f35275d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced716f5-0a63-41f0-ba6a-30f8f35275d3', 'volume_size': 1} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Flow 'volume_create_manager' (00f9efce-5427-47c4-b7b9-313326abfdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa52d02e-2473-4524-905e-0338d3d1e7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa52d02e-2473-4524-905e-0338d3d1e7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-254318476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4eeb254-2d5a-4ec2-b540-318621c75662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c53252f99640929fddf4409548b63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:48Z,use_quota=True,user_id='264c7a9a20674f0e95b903a891672da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65c6db6-42bb-41fd-923f-65b453002872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65c6db6-42bb-41fd-923f-65b453002872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (196ae358-5f9d-4040-90cc-726cee4c8a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (196ae358-5f9d-4040-90cc-726cee4c8a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4eeb254-2d5a-4ec2-b540-318621c75662', 'volume_name': 'volume-f4eeb254-2d5a-4ec2-b540-318621c75662', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be803407-7392-4f93-be5f-7f41f42a1b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be803407-7392-4f93-be5f-7f41f42a1b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dadff816-e57c-4604-a1ed-c0d19d1ea7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:47 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Volume f4eeb254-2d5a-4ec2-b540-318621c75662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4eeb254-2d5a-4ec2-b540-318621c75662', 'volume_size': 1} Jul 06 21:08:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:48 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-00058a0b-821b-4f8d-85e6-825f63da597b" returned: 0 in 0.628s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.349s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1128780228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055ca8e4-fd83-4d61-8510-0bcf7156efdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c53252f99640929fddf4409548b63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:47Z,use_quota=True,user_id='264c7a9a20674f0e95b903a891672da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Creating volume 055ca8e4-fd83-4d61-8510-0bcf7156efdf {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:08:48 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-055ca8e4-fd83-4d61-8510-0bcf7156efdf 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:48 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-055ca8e4-fd83-4d61-8510-0bcf7156efdf 1073741824 Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1982da99-400d-42e3-a4ee-12e4ec69b32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00058a0b-821b-4f8d-85e6-825f63da597b', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:48 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd36c3c-285a-4b23-a740-e7bcffeace26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:48 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Volume volume-00058a0b-821b-4f8d-85e6-825f63da597b (00058a0b-821b-4f8d-85e6-825f63da597b): created successfully Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd36c3c-285a-4b23-a740-e7bcffeace26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Flow 'volume_create_manager' (09e0ba2c-411e-4042-8057-aaec488be541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:48 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d53a036f-149c-4f4c-aa3e-76b507ff7f6d tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Created volume successfully. Jul 06 21:08:48 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-055ca8e4-fd83-4d61-8510-0bcf7156efdf 1073741824" returned: 0 in 0.786s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-055ca8e4-fd83-4d61-8510-0bcf7156efdf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:48 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-055ca8e4-fd83-4d61-8510-0bcf7156efdf Jul 06 21:08:48 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:49 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-055ca8e4-fd83-4d61-8510-0bcf7156efdf" returned: 0 in 0.704s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:08:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.502s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1564350126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4f31a1-caa0-4410-b714-f31de442edbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c53252f99640929fddf4409548b63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:47Z,use_quota=True,user_id='264c7a9a20674f0e95b903a891672da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:08:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Creating volume ea4f31a1-caa0-4410-b714-f31de442edbb {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:08:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:08:49 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:08:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ea4f31a1-caa0-4410-b714-f31de442edbb 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (583a4269-58d9-40df-b5ef-2f370e7169eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-055ca8e4-fd83-4d61-8510-0bcf7156efdf', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:49 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ea4f31a1-caa0-4410-b714-f31de442edbb 1073741824 Jul 06 21:08:49 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3580ab26-9d7d-4286-9f93-084cd0f19b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:49 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Volume volume-055ca8e4-fd83-4d61-8510-0bcf7156efdf (055ca8e4-fd83-4d61-8510-0bcf7156efdf): created successfully Jul 06 21:08:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3580ab26-9d7d-4286-9f93-084cd0f19b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Flow 'volume_create_manager' (4b21e8ab-b488-4f93-a322-acbdf99cf509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:49 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9b50d58d-29b6-46b1-9ba5-d19289c964cc tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Created volume successfully. Jul 06 21:08:50 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ea4f31a1-caa0-4410-b714-f31de442edbb 1073741824" returned: 0 in 0.885s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ea4f31a1-caa0-4410-b714-f31de442edbb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:50 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ea4f31a1-caa0-4410-b714-f31de442edbb Jul 06 21:08:50 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:51 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ea4f31a1-caa0-4410-b714-f31de442edbb" returned: 0 in 0.623s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:08:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.656s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1070108323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced716f5-0a63-41f0-ba6a-30f8f35275d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c53252f99640929fddf4409548b63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:47Z,use_quota=True,user_id='264c7a9a20674f0e95b903a891672da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:08:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Creating volume ced716f5-0a63-41f0-ba6a-30f8f35275d3 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:08:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:08:51 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:08:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ced716f5-0a63-41f0-ba6a-30f8f35275d3 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f963ad9-db62-4a50-a000-1a2f7f3c319b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea4f31a1-caa0-4410-b714-f31de442edbb', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041c4ea6-cb1d-4b26-a07f-7122cf61396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:51 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ced716f5-0a63-41f0-ba6a-30f8f35275d3 1073741824 Jul 06 21:08:51 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:51 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Volume volume-ea4f31a1-caa0-4410-b714-f31de442edbb (ea4f31a1-caa0-4410-b714-f31de442edbb): created successfully Jul 06 21:08:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041c4ea6-cb1d-4b26-a07f-7122cf61396b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Flow 'volume_create_manager' (4e125ce3-717a-430b-a65f-81321407b007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:51 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f778ff06-d0f0-4858-89f4-9cdd67592e23 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Created volume successfully. Jul 06 21:08:52 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ced716f5-0a63-41f0-ba6a-30f8f35275d3 1073741824" returned: 0 in 0.808s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ced716f5-0a63-41f0-ba6a-30f8f35275d3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:52 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ced716f5-0a63-41f0-ba6a-30f8f35275d3 Jul 06 21:08:52 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:52 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ced716f5-0a63-41f0-ba6a-30f8f35275d3" returned: 0 in 0.669s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.884s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-254318476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4eeb254-2d5a-4ec2-b540-318621c75662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c53252f99640929fddf4409548b63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:48Z,use_quota=True,user_id='264c7a9a20674f0e95b903a891672da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Creating volume f4eeb254-2d5a-4ec2-b540-318621c75662 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:08:52 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f4eeb254-2d5a-4ec2-b540-318621c75662 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:52 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f4eeb254-2d5a-4ec2-b540-318621c75662 1073741824 Jul 06 21:08:52 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2eea177-abd9-4285-b5f4-6fbcf128cbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced716f5-0a63-41f0-ba6a-30f8f35275d3', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de1a7ee-17f2-45ef-917b-2f06710738ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=31,cinder:UPDATE=42,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:08:52 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Volume volume-ced716f5-0a63-41f0-ba6a-30f8f35275d3 (ced716f5-0a63-41f0-ba6a-30f8f35275d3): created successfully Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de1a7ee-17f2-45ef-917b-2f06710738ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:52 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Flow 'volume_create_manager' (3d1f74ba-03c2-494f-ba97-5caf9d46581e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:52 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-36b51c36-255b-4d92-bee9-e8b18440cd2b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Created volume successfully. Jul 06 21:08:53 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f4eeb254-2d5a-4ec2-b540-318621c75662 1073741824" returned: 0 in 0.784s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f4eeb254-2d5a-4ec2-b540-318621c75662 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:53 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f4eeb254-2d5a-4ec2-b540-318621c75662 Jul 06 21:08:53 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:54 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f4eeb254-2d5a-4ec2-b540-318621c75662" returned: 0 in 0.600s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:08:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dadff816-e57c-4604-a1ed-c0d19d1ea7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4eeb254-2d5a-4ec2-b540-318621c75662', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654a1b7d-0b1a-4653-b630-c9332ca6596b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:54 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Volume volume-f4eeb254-2d5a-4ec2-b540-318621c75662 (f4eeb254-2d5a-4ec2-b540-318621c75662): created successfully Jul 06 21:08:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654a1b7d-0b1a-4653-b630-c9332ca6596b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Flow 'volume_create_manager' (00f9efce-5427-47c4-b7b9-313326abfdd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:54 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-842d7b62-bb8d-455b-ae04-c3e1ed07d621 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Created volume successfully. Jul 06 21:08:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "cinder-f4eeb254-2d5a-4ec2-b540-318621c75662-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-f4eeb254-2d5a-4ec2-b540-318621c75662-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "cinder-quobyte-f4eeb254-2d5a-4ec2-b540-318621c75662" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-quobyte-f4eeb254-2d5a-4ec2-b540-318621c75662" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:54 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d47369-1bda-4798-a7bc-d28b250d6b64]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:08:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f4eeb254-2d5a-4ec2-b540-318621c75662 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:54 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f4eeb254-2d5a-4ec2-b540-318621c75662 Jul 06 21:08:54 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:55 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f4eeb254-2d5a-4ec2-b540-318621c75662" returned: 0 in 0.768s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f4eeb254-2d5a-4ec2-b540-318621c75662 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:55 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f4eeb254-2d5a-4ec2-b540-318621c75662 Jul 06 21:08:55 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:55 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f4eeb254-2d5a-4ec2-b540-318621c75662" returned: 0 in 0.614s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-quobyte-f4eeb254-2d5a-4ec2-b540-318621c75662" released by "delete_volume" :: held 1.418s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:55 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Created reservations ['f4b631c5-7382-4514-bbd2-56e07dfe4ced', '448aca62-f0cc-4bc4-b59d-50d394273ef2', 'befe4652-88e1-46e0-a6c2-f89408024926', '65799424-3a38-45d9-9a4b-30d79d882c7e'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:08:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:55 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:08:55 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:56 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.627s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:56 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:08:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "cinder-ced716f5-0a63-41f0-ba6a-30f8f35275d3-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:56 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Deleted volume successfully. Jul 06 21:08:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-ced716f5-0a63-41f0-ba6a-30f8f35275d3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f7080f3c-ef74-45d9-9e22-ca609db413e2 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-f4eeb254-2d5a-4ec2-b540-318621c75662-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "cinder-quobyte-ced716f5-0a63-41f0-ba6a-30f8f35275d3" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-quobyte-ced716f5-0a63-41f0-ba6a-30f8f35275d3" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:56 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a88396-2d22-4625-b670-af0ae36a3664]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:08:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ced716f5-0a63-41f0-ba6a-30f8f35275d3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:56 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ced716f5-0a63-41f0-ba6a-30f8f35275d3 Jul 06 21:08:56 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:57 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ced716f5-0a63-41f0-ba6a-30f8f35275d3" returned: 0 in 0.764s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ced716f5-0a63-41f0-ba6a-30f8f35275d3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:57 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ced716f5-0a63-41f0-ba6a-30f8f35275d3 Jul 06 21:08:57 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:58 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ced716f5-0a63-41f0-ba6a-30f8f35275d3" returned: 0 in 0.628s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:58 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:08:58 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-quobyte-ced716f5-0a63-41f0-ba6a-30f8f35275d3" released by "delete_volume" :: held 1.429s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Created reservations ['18729c85-0c8d-483e-86cf-790975f1d3f0', 'ee20eb1b-fe01-407f-b615-b6b5f8a83c49', '7ffa96c2-711f-4cd5-9152-3bd4c4a5e678', 'f0db3eb7-5df8-460a-aefb-dfcb6ac3fda6'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:58 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:08:58 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:58 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.694s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "cinder-ea4f31a1-caa0-4410-b714-f31de442edbb-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-ea4f31a1-caa0-4410-b714-f31de442edbb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:58 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.646s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:08:58 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Deleted volume successfully. Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "cinder-quobyte-ea4f31a1-caa0-4410-b714-f31de442edbb" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7fcfd4a4-09ef-4963-9864-a630b043fa22 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-ced716f5-0a63-41f0-ba6a-30f8f35275d3-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-quobyte-ea4f31a1-caa0-4410-b714-f31de442edbb" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78c803e-e851-48ba-9b9d-de4c793f9590]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:08:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ea4f31a1-caa0-4410-b714-f31de442edbb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:59 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ea4f31a1-caa0-4410-b714-f31de442edbb Jul 06 21:08:59 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:59 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ea4f31a1-caa0-4410-b714-f31de442edbb" returned: 0 in 0.712s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ea4f31a1-caa0-4410-b714-f31de442edbb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:59 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ea4f31a1-caa0-4410-b714-f31de442edbb Jul 06 21:08:59 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:00 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ea4f31a1-caa0-4410-b714-f31de442edbb" returned: 0 in 0.615s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-quobyte-ea4f31a1-caa0-4410-b714-f31de442edbb" released by "delete_volume" :: held 1.364s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:00 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Created reservations ['67d12d8f-0315-437c-966d-5e62a5ec313f', 'fa044be0-3ae0-4fc4-abda-ab1a72024b1a', '6b9ad34b-cbe4-401b-aa9d-58a3dcc85e2e', 'ed0ab511-06af-4221-8b14-e30d05a233e5'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:09:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:00 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:09:00 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:00 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.609s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:00 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:00 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Deleted volume successfully. Jul 06 21:09:01 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-6c70f214-c80e-4970-9b21-1245d2e9c1cb tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-ea4f31a1-caa0-4410-b714-f31de442edbb-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:01 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "cinder-055ca8e4-fd83-4d61-8510-0bcf7156efdf-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:01 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-055ca8e4-fd83-4d61-8510-0bcf7156efdf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:01 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "cinder-quobyte-055ca8e4-fd83-4d61-8510-0bcf7156efdf" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:01 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-quobyte-055ca8e4-fd83-4d61-8510-0bcf7156efdf" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:01 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7516be3f-ad8b-44a5-b451-1aec278b2e63]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-055ca8e4-fd83-4d61-8510-0bcf7156efdf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:01 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-055ca8e4-fd83-4d61-8510-0bcf7156efdf Jul 06 21:09:01 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:01 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-055ca8e4-fd83-4d61-8510-0bcf7156efdf" returned: 0 in 0.733s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-055ca8e4-fd83-4d61-8510-0bcf7156efdf {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:01 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-055ca8e4-fd83-4d61-8510-0bcf7156efdf Jul 06 21:09:01 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:02 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-055ca8e4-fd83-4d61-8510-0bcf7156efdf" returned: 0 in 0.632s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-quobyte-055ca8e4-fd83-4d61-8510-0bcf7156efdf" released by "delete_volume" :: held 1.401s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:02 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Created reservations ['d772b76f-5788-4d98-9090-00e00e9ad4eb', 'b4b6e90a-b6eb-40c5-a990-b441325c01fe', '94e744b5-eef1-4825-b8ef-a4502565beac', 'ccee74da-3e6e-4f5a-93fc-210c4a3f3ffe'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:09:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:02 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:09:02 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:03 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.623s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:03 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:03 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Deleted volume successfully. Jul 06 21:09:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-94106b9e-8232-4a26-b724-e44fd33fec8c tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-055ca8e4-fd83-4d61-8510-0bcf7156efdf-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "cinder-00058a0b-821b-4f8d-85e6-825f63da597b-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-00058a0b-821b-4f8d-85e6-825f63da597b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "cinder-quobyte-00058a0b-821b-4f8d-85e6-825f63da597b" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-quobyte-00058a0b-821b-4f8d-85e6-825f63da597b" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:03 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a749cf-e422-4d15-aeda-09f8480968cb]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-00058a0b-821b-4f8d-85e6-825f63da597b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:03 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-00058a0b-821b-4f8d-85e6-825f63da597b Jul 06 21:09:03 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:04 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-00058a0b-821b-4f8d-85e6-825f63da597b" returned: 0 in 0.709s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-00058a0b-821b-4f8d-85e6-825f63da597b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:04 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-00058a0b-821b-4f8d-85e6-825f63da597b Jul 06 21:09:04 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:04 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-00058a0b-821b-4f8d-85e6-825f63da597b" returned: 0 in 0.607s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-quobyte-00058a0b-821b-4f8d-85e6-825f63da597b" released by "delete_volume" :: held 1.349s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:04 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Created reservations ['cca46b96-0915-4521-a67e-4c0bea191c9d', '8f805973-c4c9-4e8b-9ee4-83facafd42ac', 'b725fc26-6e6d-417e-bb2b-8935ed638553', '467ea541-c330-4481-a554-7094be75509d'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:09:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:04 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:09:04 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:05 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.624s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:05 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:05 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Deleted volume successfully. Jul 06 21:09:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ff7233f9-ae82-4e27-acec-27946ae09cc7 tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-00058a0b-821b-4f8d-85e6-825f63da597b-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "cinder-ef74eda9-d796-4a99-8622-2cf61ff25195-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-ef74eda9-d796-4a99-8622-2cf61ff25195-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "cinder-quobyte-ef74eda9-d796-4a99-8622-2cf61ff25195" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-quobyte-ef74eda9-d796-4a99-8622-2cf61ff25195" acquired by "delete_volume" :: waited 0.012s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:05 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2099153-7c51-42eb-89cc-bc128b1a85c7]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef74eda9-d796-4a99-8622-2cf61ff25195 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:05 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef74eda9-d796-4a99-8622-2cf61ff25195 Jul 06 21:09:05 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:06 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef74eda9-d796-4a99-8622-2cf61ff25195" returned: 0 in 0.716s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef74eda9-d796-4a99-8622-2cf61ff25195 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:06 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef74eda9-d796-4a99-8622-2cf61ff25195 Jul 06 21:09:06 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:06 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ef74eda9-d796-4a99-8622-2cf61ff25195" returned: 0 in 0.627s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-quobyte-ef74eda9-d796-4a99-8622-2cf61ff25195" released by "delete_volume" :: held 1.378s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:06 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Created reservations ['c8770492-7445-49ef-b995-7ba8a857f5b6', '90ecd9b2-1daa-44c6-9157-b21835d861ff', 'e2e3eb60-9381-4435-9e63-09c3a3b91f72', '011ef926-3dae-4b53-a450-7082da7075ef'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:09:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:07 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:07 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:09:07 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:07 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.631s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:07 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:07 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Deleted volume successfully. Jul 06 21:09:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ff51f439-e1e5-4e67-8c6b-1c4bbe09176b tempest-CreateVolumesFromSourceVolumeTest-1657552060 None] Lock "cinder-ef74eda9-d796-4a99-8622-2cf61ff25195-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:12 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Flow 'volume_create_manager' (0d35e605-9a0f-4034-a924-35420be5ba18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5cbb0a-9f90-45c3-bcd4-8c71f5982481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5cbb0a-9f90-45c3-bcd4-8c71f5982481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf1b5e85-fc38-4090-b340-474461d6b4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9afef2656444dc9961566643d7015cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:12Z,use_quota=True,user_id='66c22b08c41940be810573a0ce50f7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4142810c-5eba-4e69-9d16-79b4017a20a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4142810c-5eba-4e69-9d16-79b4017a20a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4649632c-0368-4807-9a3e-89f32d56fa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:12 devstack cinder-volume[87207]: DEBUG cinder.image.glance [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Creating Keystone auth plugin from conf {{(pid=87207) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 21:09:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4649632c-0368-4807-9a3e-89f32d56fa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf1b5e85-fc38-4090-b340-474461d6b4db', 'volume_name': 'volume-cf1b5e85-fc38-4090-b340-474461d6b4db', 'volume_size': 1, 'image_id': 'eebb11d7-bbaf-42d7-83bb-f9b16302426c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eebb11d7-bbaf-42d7-83bb-f9b16302426c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6084aa3176dc350ab7741e08e3ffe0f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c9afef2656444dc9961566643d7015cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd6c814807c35ab25d7f87de417e1e1b2b156c540ef5e123ab0a11979c5e673460b85f52591b0e3b19039ef961705eea36ab017c81ed0c27c58cb69d1274f398f', 'id': 'eebb11d7-bbaf-42d7-83bb-f9b16302426c', 'created_at': datetime.datetime(2026, 7, 6, 19, 9, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 9, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eebb11d7-bbaf-42d7-83bb-f9b16302426c/file', 'properties': {}}, 'image_service': }' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef34814-9d53-40d0-bf41-d57559d747d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef34814-9d53-40d0-bf41-d57559d747d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:12 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4470c33b-65bc-4b26-be09-9213cbfd86e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:12 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Volume cf1b5e85-fc38-4090-b340-474461d6b4db: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf1b5e85-fc38-4090-b340-474461d6b4db', 'volume_size': 1, 'image_id': 'eebb11d7-bbaf-42d7-83bb-f9b16302426c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eebb11d7-bbaf-42d7-83bb-f9b16302426c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6084aa3176dc350ab7741e08e3ffe0f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c9afef2656444dc9961566643d7015cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd6c814807c35ab25d7f87de417e1e1b2b156c540ef5e123ab0a11979c5e673460b85f52591b0e3b19039ef961705eea36ab017c81ed0c27c58cb69d1274f398f', 'id': 'eebb11d7-bbaf-42d7-83bb-f9b16302426c', 'created_at': datetime.datetime(2026, 7, 6, 19, 9, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 9, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eebb11d7-bbaf-42d7-83bb-f9b16302426c/file', 'properties': {}}, 'image_service': } Jul 06 21:09:12 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Trying to clone cf1b5e85-fc38-4090-b340-474461d6b4db from image eebb11d7-bbaf-42d7-83bb-f9b16302426c at location (None, [{'url': 'file:///opt/stack/data/glance/images/eebb11d7-bbaf-42d7-83bb-f9b16302426c', 'metadata': {}}]). {{(pid=87207) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 21:09:12 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 21:09:12 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Image download 0.00 MB at 0.00 MB/s Jul 06 21:09:12 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5b6251-3747-40ef-bdc1-cff71e1b4db5]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:12 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD Jul 06 21:09:12 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:13 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD" returned: 0 in 0.680s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:13 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD Jul 06 21:09:13 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:14 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD" returned: 1 in 0.674s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:09:14 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Temporary image eebb11d7-bbaf-42d7-83bb-f9b16302426c is fetched for user 66c22b08c41940be810573a0ce50f7d7. {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 21:09:14 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[612d5cbb-29b3-45c3-b374-47e4a77440af]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:14 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD Jul 06 21:09:14 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:14 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD" returned: 0 in 0.694s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:14 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD Jul 06 21:09:14 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:15 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD" returned: 1 in 0.670s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:09:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf1b5e85-fc38-4090-b340-474461d6b4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9afef2656444dc9961566643d7015cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:12Z,use_quota=True,user_id='66c22b08c41940be810573a0ce50f7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:09:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Creating volume cf1b5e85-fc38-4090-b340-474461d6b4db {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:09:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:09:15 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:09:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:15 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db 1073741824 Jul 06 21:09:15 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:16 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db 1073741824" returned: 0 in 0.756s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:16 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db Jul 06 21:09:16 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:16 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db" returned: 0 in 0.665s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:09:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:16 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Attempting download of eebb11d7-bbaf-42d7-83bb-f9b16302426c ((None, [{'url': 'file:///opt/stack/data/glance/images/eebb11d7-bbaf-42d7-83bb-f9b16302426c', 'metadata': {}}])) to volume cf1b5e85-fc38-4090-b340-474461d6b4db. {{(pid=87207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 21:09:17 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f24cf1-33d3-4980-8762-20c77b3c9ac7]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eebb11d7-bbaf-42d7-83bb-f9b16302426c_3msbiu4g {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:17 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eebb11d7-bbaf-42d7-83bb-f9b16302426c_3msbiu4g Jul 06 21:09:17 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:17 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eebb11d7-bbaf-42d7-83bb-f9b16302426c_3msbiu4g" returned: 0 in 0.711s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eebb11d7-bbaf-42d7-83bb-f9b16302426c_3msbiu4g {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:17 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eebb11d7-bbaf-42d7-83bb-f9b16302426c_3msbiu4g Jul 06 21:09:17 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:18 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eebb11d7-bbaf-42d7-83bb-f9b16302426c_3msbiu4g" returned: 1 in 0.685s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eebb11d7-bbaf-42d7-83bb-f9b16302426c_3msbiu4g' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:09:18 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[729356bf-e4c7-4202-9bec-d913bf5eaab6]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:18 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD Jul 06 21:09:18 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:19 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD" returned: 0 in 0.675s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:19 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD Jul 06 21:09:19 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:19 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD" returned: 1 in 0.689s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:09:19 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] eebb11d7-bbaf-42d7-83bb-f9b16302426c was raw, converting to raw {{(pid=87207) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 21:09:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:19 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db Jul 06 21:09:19 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:20 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db" returned: 0 in 0.680s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:20 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eebb11d7-bbaf-42d7-83bb-f9b16302426c_79qapi6sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:09:20 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 21:09:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:20 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db 1G Jul 06 21:09:20 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:21 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db 1G" returned: 0 in 0.648s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:21 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea0e659-f6ce-43ce-9052-b73553ebcc8e]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:21 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db Jul 06 21:09:21 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:21 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db" returned: 0 in 0.733s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:22 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db Jul 06 21:09:22 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:22 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db" returned: 1 in 0.722s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:09:22 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Downloaded image eebb11d7-bbaf-42d7-83bb-f9b16302426c ((None, [{'url': 'file:///opt/stack/data/glance/images/eebb11d7-bbaf-42d7-83bb-f9b16302426c', 'metadata': {}}])) to volume cf1b5e85-fc38-4090-b340-474461d6b4db successfully. {{(pid=87207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 21:09:22 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Temporary image eebb11d7-bbaf-42d7-83bb-f9b16302426c for user 66c22b08c41940be810573a0ce50f7d7 is deleted. {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 21:09:22 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Marking volume cf1b5e85-fc38-4090-b340-474461d6b4db as bootable. {{(pid=87207) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 21:09:22 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Copying metadata from image eebb11d7-bbaf-42d7-83bb-f9b16302426c to cf1b5e85-fc38-4090-b340-474461d6b4db. {{(pid=87207) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 21:09:22 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Creating volume glance metadata for volume cf1b5e85-fc38-4090-b340-474461d6b4db backed by image eebb11d7-bbaf-42d7-83bb-f9b16302426c with: {'image_id': 'eebb11d7-bbaf-42d7-83bb-f9b16302426c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6084aa3176dc350ab7741e08e3ffe0f7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87207) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 21:09:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4470c33b-65bc-4b26-be09-9213cbfd86e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf1b5e85-fc38-4090-b340-474461d6b4db', 'volume_size': 1, 'image_id': 'eebb11d7-bbaf-42d7-83bb-f9b16302426c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eebb11d7-bbaf-42d7-83bb-f9b16302426c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6084aa3176dc350ab7741e08e3ffe0f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c9afef2656444dc9961566643d7015cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd6c814807c35ab25d7f87de417e1e1b2b156c540ef5e123ab0a11979c5e673460b85f52591b0e3b19039ef961705eea36ab017c81ed0c27c58cb69d1274f398f', 'id': 'eebb11d7-bbaf-42d7-83bb-f9b16302426c', 'created_at': datetime.datetime(2026, 7, 6, 19, 9, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 9, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eebb11d7-bbaf-42d7-83bb-f9b16302426c/file', 'properties': {}}, 'image_service': }' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552414db-7f85-4f63-9ea1-039d463d1f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:22 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Volume volume-cf1b5e85-fc38-4090-b340-474461d6b4db (cf1b5e85-fc38-4090-b340-474461d6b4db): created successfully Jul 06 21:09:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552414db-7f85-4f63-9ea1-039d463d1f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Flow 'volume_create_manager' (0d35e605-9a0f-4034-a924-35420be5ba18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:22 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-916d2a38-e182-4c99-9e14-475bad5f4c49 tempest-VolumeImageDependencyTests-1123918917 None] Created volume successfully. Jul 06 21:09:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] Acquiring lock "cinder-cf1b5e85-fc38-4090-b340-474461d6b4db-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] Lock "cinder-cf1b5e85-fc38-4090-b340-474461d6b4db-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] Acquiring lock "cinder-quobyte-cf1b5e85-fc38-4090-b340-474461d6b4db" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] Lock "cinder-quobyte-cf1b5e85-fc38-4090-b340-474461d6b4db" acquired by "delete_volume" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:23 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76a6284-020f-488e-8876-500d54fa04f0]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:23 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db Jul 06 21:09:23 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:23 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db" returned: 0 in 0.710s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:23 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db Jul 06 21:09:23 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:24 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db" returned: 1 in 0.704s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:09:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:24 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db Jul 06 21:09:24 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:25 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cf1b5e85-fc38-4090-b340-474461d6b4db" returned: 0 in 0.612s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:25 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] Lock "cinder-quobyte-cf1b5e85-fc38-4090-b340-474461d6b4db" released by "delete_volume" :: held 2.084s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:25 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] Created reservations ['ab33fd60-c32b-49fb-b32a-ad3daa73fdf2', 'def2dd8d-ea6f-4cb9-a742-5967d71e7755', '8c4fa17b-c569-4cf1-b3a5-f30f82b9d6af', '8d31a25f-b9ea-4080-8137-413ca69d95b3'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:09:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:25 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:09:25 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:25 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.611s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:25 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:25 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] Deleted volume successfully. Jul 06 21:09:25 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ab7f08cc-9d3d-47c4-b8e8-37994fb66043 tempest-VolumeImageDependencyTests-1123918917 None] Lock "cinder-cf1b5e85-fc38-4090-b340-474461d6b4db-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:35 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=54,cinder:INSERT=24,cinder:UPDATE=77,cinder:DELETE=7 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:09:35 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=46,cinder:UPDATE=63,cinder:INSERT=18,cinder:DELETE=6 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Flow 'volume_create_manager' (2d87604c-e38f-4c2b-8210-d48da548fe54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b63a1de-73d5-4d7b-a9fe-c564cb982531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b63a1de-73d5-4d7b-a9fe-c564cb982531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1446887807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adfd1324-dce3-47b2-9574-ddbc9378e80b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3ab1a2e04242cd99d99e59747d302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:42Z,use_quota=True,user_id='ac5b5eecaff444d4adcb4f2dc73a6040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542fb896-fda3-499e-8dac-ba6b111198ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542fb896-fda3-499e-8dac-ba6b111198ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8e86ac-5aed-4bf7-9c4e-aef049fd4841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8e86ac-5aed-4bf7-9c4e-aef049fd4841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adfd1324-dce3-47b2-9574-ddbc9378e80b', 'volume_name': 'volume-adfd1324-dce3-47b2-9574-ddbc9378e80b', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475336e4-bc89-4879-ba97-f6256393a404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475336e4-bc89-4879-ba97-f6256393a404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b638343-8331-439e-bbe5-b4d2ad9497a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:42 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Volume adfd1324-dce3-47b2-9574-ddbc9378e80b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adfd1324-dce3-47b2-9574-ddbc9378e80b', 'volume_size': 1} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1446887807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adfd1324-dce3-47b2-9574-ddbc9378e80b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3ab1a2e04242cd99d99e59747d302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:42Z,use_quota=True,user_id='ac5b5eecaff444d4adcb4f2dc73a6040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Creating volume adfd1324-dce3-47b2-9574-ddbc9378e80b {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:09:42 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-adfd1324-dce3-47b2-9574-ddbc9378e80b 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:42 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-adfd1324-dce3-47b2-9574-ddbc9378e80b 1073741824 Jul 06 21:09:42 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Flow 'volume_create_manager' (8015470f-ff94-404c-b5fd-72e84ec9d36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8842d8e2-8f6a-4872-b86e-95386c1e45c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8842d8e2-8f6a-4872-b86e-95386c1e45c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa5d3b4-146f-40a4-b69b-43abecd3f030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3a8656264d42288a71dd13519e8afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:43Z,use_quota=True,user_id='6d47959787b34e2cabc5c564c8e8130a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4fa44c1-23d6-4866-8b76-fa5647a6f2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4fa44c1-23d6-4866-8b76-fa5647a6f2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ca28b7-cfc3-4f60-b7bb-0257d09c2f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ca28b7-cfc3-4f60-b7bb-0257d09c2f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aa5d3b4-146f-40a4-b69b-43abecd3f030', 'volume_name': 'volume-9aa5d3b4-146f-40a4-b69b-43abecd3f030', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b7db0f-a50a-4d13-8a82-d9ac3146f8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b7db0f-a50a-4d13-8a82-d9ac3146f8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a68518-788c-475e-9797-8b0e1582a373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:42 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Volume 9aa5d3b4-146f-40a4-b69b-43abecd3f030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aa5d3b4-146f-40a4-b69b-43abecd3f030', 'volume_size': 1} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Flow 'volume_create_manager' (8e68c11b-6cef-43da-9fec-7f8015dcd585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f7b90a-518f-46c5-b42f-03305af09814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f7b90a-518f-46c5-b42f-03305af09814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1362533618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c152e8e4-b596-43ab-8918-cfc842f9c9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3ab1a2e04242cd99d99e59747d302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:43Z,use_quota=True,user_id='ac5b5eecaff444d4adcb4f2dc73a6040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa451350-7c55-4828-aa24-842cdcbfe3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa451350-7c55-4828-aa24-842cdcbfe3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d608d734-5d72-4512-97de-86782930e8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d608d734-5d72-4512-97de-86782930e8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c152e8e4-b596-43ab-8918-cfc842f9c9e8', 'volume_name': 'volume-c152e8e4-b596-43ab-8918-cfc842f9c9e8', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05e2cb8-6039-4176-a39a-d1442700c9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05e2cb8-6039-4176-a39a-d1442700c9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ccc0d3-8999-411d-9dae-bca70b4ce1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:43 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Volume c152e8e4-b596-43ab-8918-cfc842f9c9e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c152e8e4-b596-43ab-8918-cfc842f9c9e8', 'volume_size': 1} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Flow 'volume_create_manager' (d927f3ad-2c37-4837-8a75-c2e44938c23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094022ed-dac0-4fb4-83d3-66d537833f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094022ed-dac0-4fb4-83d3-66d537833f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1414742107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc3f511-98d0-4d62-8e83-ee6993a5b3bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3ab1a2e04242cd99d99e59747d302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:43Z,use_quota=True,user_id='ac5b5eecaff444d4adcb4f2dc73a6040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aee3a87-2502-4fe2-8046-de3e21fb2f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aee3a87-2502-4fe2-8046-de3e21fb2f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed02af9f-1834-42f7-b107-219eb7604237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed02af9f-1834-42f7-b107-219eb7604237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fc3f511-98d0-4d62-8e83-ee6993a5b3bc', 'volume_name': 'volume-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2abcf761-44e8-48e7-afad-5ec45ca3a38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2abcf761-44e8-48e7-afad-5ec45ca3a38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfd8a25-02bf-40ac-9fc0-a84dfc80458b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:43 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Volume 3fc3f511-98d0-4d62-8e83-ee6993a5b3bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc', 'volume_size': 1} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Flow 'volume_create_manager' (36e244c3-cc27-4b87-99fb-d4568602ecbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53eab2cc-c6e8-4e07-919a-ebf071a6e06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53eab2cc-c6e8-4e07-919a-ebf071a6e06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1445918111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3ab1a2e04242cd99d99e59747d302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:43Z,use_quota=True,user_id='ac5b5eecaff444d4adcb4f2dc73a6040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b9369e-770f-421f-b6cf-23354710e4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b9369e-770f-421f-b6cf-23354710e4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9aafe3b-cf40-4655-bfbd-ee96c04c0331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9aafe3b-cf40-4655-bfbd-ee96c04c0331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07', 'volume_name': 'volume-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4b13cd-a44a-4342-85d7-c17288860b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4b13cd-a44a-4342-85d7-c17288860b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8be99f-cd9d-4743-bf47-4ece64443610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:43 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Volume bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07', 'volume_size': 1} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:43 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-adfd1324-dce3-47b2-9574-ddbc9378e80b 1073741824" returned: 0 in 1.401s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Flow 'volume_create_manager' (4f3566f2-ecf8-4729-8029-5e5215ca77f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ddf87bb-8900-4991-83f0-ed126d78e7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ddf87bb-8900-4991-83f0-ed126d78e7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2107401037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4fb03b-789a-439f-a17d-fec38b9f5adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3ab1a2e04242cd99d99e59747d302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:44Z,use_quota=True,user_id='ac5b5eecaff444d4adcb4f2dc73a6040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9693f2-1d3d-4fb7-9931-b0de99d63f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9693f2-1d3d-4fb7-9931-b0de99d63f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587559cb-76da-483d-873c-75d3c443d832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587559cb-76da-483d-873c-75d3c443d832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b4fb03b-789a-439f-a17d-fec38b9f5adc', 'volume_name': 'volume-4b4fb03b-789a-439f-a17d-fec38b9f5adc', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44065736-2f73-4db6-87ad-5f012e6646ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44065736-2f73-4db6-87ad-5f012e6646ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6debccc3-1262-4653-8018-78972b246ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:44 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Volume 4b4fb03b-789a-439f-a17d-fec38b9f5adc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b4fb03b-789a-439f-a17d-fec38b9f5adc', 'volume_size': 1} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-adfd1324-dce3-47b2-9574-ddbc9378e80b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:44 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-adfd1324-dce3-47b2-9574-ddbc9378e80b Jul 06 21:09:44 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:44 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-adfd1324-dce3-47b2-9574-ddbc9378e80b" returned: 0 in 0.760s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] <== create_volume: return (2309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.315s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.971s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa5d3b4-146f-40a4-b69b-43abecd3f030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3a8656264d42288a71dd13519e8afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:43Z,use_quota=True,user_id='6d47959787b34e2cabc5c564c8e8130a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Creating volume 9aa5d3b4-146f-40a4-b69b-43abecd3f030 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:09:44 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9aa5d3b4-146f-40a4-b69b-43abecd3f030 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:44 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9aa5d3b4-146f-40a4-b69b-43abecd3f030 1073741824 Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b638343-8331-439e-bbe5-b4d2ad9497a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adfd1324-dce3-47b2-9574-ddbc9378e80b', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:44 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f6833a-ab4a-44ec-8286-bc785b8a1c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:44 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Volume volume-adfd1324-dce3-47b2-9574-ddbc9378e80b (adfd1324-dce3-47b2-9574-ddbc9378e80b): created successfully Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f6833a-ab4a-44ec-8286-bc785b8a1c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Flow 'volume_create_manager' (2d87604c-e38f-4c2b-8210-d48da548fe54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:44 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-cfd7d0af-79ea-49e5-990b-c49e8cda9727 tempest-CreateVolumesFromImageTest-351969944 None] Created volume successfully. Jul 06 21:09:45 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Flow 'volume_create_manager' (7fbae94c-3092-4493-bb46-a82d10b04e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f303212-822c-40e3-9f58-550e64cbfcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f303212-822c-40e3-9f58-550e64cbfcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6611c7a-1447-44ea-bdb2-bd4fd5e82b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c39dd1b8be4479f88eb79dbe852d4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:46Z,use_quota=True,user_id='4bc385d1fa744492a186dae6fdd86e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af17bd5e-edc1-4c04-8ef9-dd4f7ee511ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:45 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af17bd5e-edc1-4c04-8ef9-dd4f7ee511ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c65a21-81a8-4b93-a913-4de9cfb20bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:45 devstack cinder-volume[87207]: DEBUG cinder.image.glance [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Creating Keystone auth plugin from conf {{(pid=87207) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 21:09:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9aa5d3b4-146f-40a4-b69b-43abecd3f030 1073741824" returned: 0 in 1.041s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9aa5d3b4-146f-40a4-b69b-43abecd3f030 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:45 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9aa5d3b4-146f-40a4-b69b-43abecd3f030 Jul 06 21:09:45 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c65a21-81a8-4b93-a913-4de9cfb20bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e6611c7a-1447-44ea-bdb2-bd4fd5e82b09', 'volume_name': 'volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09', 'volume_size': 1, 'image_id': 'ab435561-96c1-4587-b842-8117cafb6854', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab435561-96c1-4587-b842-8117cafb6854', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ee2e0098cc372b60ba86685306c002b1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7c39dd1b8be4479f88eb79dbe852d4bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c9a600d4e5950952e2aebdaafbf318d891e034871e63eca4b13a4c784bb591f4b987047bbf15a7e76f7e24d1283d60516610c836488b4ba3f88bd58f6db9b51b', 'id': 'ab435561-96c1-4587-b842-8117cafb6854', 'created_at': datetime.datetime(2026, 7, 6, 19, 9, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 9, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab435561-96c1-4587-b842-8117cafb6854/file', 'properties': {}}, 'image_service': }' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af00e80e-fbf5-4873-b3ef-471f4772bf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af00e80e-fbf5-4873-b3ef-471f4772bf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a8f6f54-3ccd-4fb7-bb2d-7d61cfc65693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:46 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Volume e6611c7a-1447-44ea-bdb2-bd4fd5e82b09: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09', 'volume_size': 1, 'image_id': 'ab435561-96c1-4587-b842-8117cafb6854', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab435561-96c1-4587-b842-8117cafb6854', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ee2e0098cc372b60ba86685306c002b1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7c39dd1b8be4479f88eb79dbe852d4bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c9a600d4e5950952e2aebdaafbf318d891e034871e63eca4b13a4c784bb591f4b987047bbf15a7e76f7e24d1283d60516610c836488b4ba3f88bd58f6db9b51b', 'id': 'ab435561-96c1-4587-b842-8117cafb6854', 'created_at': datetime.datetime(2026, 7, 6, 19, 9, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 9, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab435561-96c1-4587-b842-8117cafb6854/file', 'properties': {}}, 'image_service': } Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Trying to clone e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 from image ab435561-96c1-4587-b842-8117cafb6854 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ab435561-96c1-4587-b842-8117cafb6854', 'metadata': {}}]). {{(pid=87207) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 21:09:46 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Image download 0.00 MB at 0.00 MB/s Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff88b8b7-8970-43cf-81cf-d230943b167a]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:46 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD Jul 06 21:09:46 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Flow 'volume_create_manager' (f3558779-6712-4d27-9e22-a1d7e3385e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d593a45d-6114-4457-8157-2185befd2193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d593a45d-6114-4457-8157-2185befd2193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3c4493-17c5-4cd3-8957-655701a9b2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39090fff3da497d80870038d6023d06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:46Z,use_quota=True,user_id='9d3dc80915b4428a807268d2f10c0ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6baec08a-7a56-4f1c-bbe3-bf50ab1912f3),volume_type_id=6baec08a-7a56-4f1c-bbe3-bf50ab1912f3)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a372d0f3-a70d-4ac9-83d7-5489b74d2ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a372d0f3-a70d-4ac9-83d7-5489b74d2ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97f28ff-4b50-4f6e-bb0d-f101ae73737f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.image.glance [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Creating Keystone auth plugin from conf {{(pid=87207) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 21:09:46 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9aa5d3b4-146f-40a4-b69b-43abecd3f030" returned: 0 in 0.962s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.837s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1362533618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c152e8e4-b596-43ab-8918-cfc842f9c9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3ab1a2e04242cd99d99e59747d302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:43Z,use_quota=True,user_id='ac5b5eecaff444d4adcb4f2dc73a6040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Creating volume c152e8e4-b596-43ab-8918-cfc842f9c9e8 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:09:46 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c152e8e4-b596-43ab-8918-cfc842f9c9e8 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:46 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c152e8e4-b596-43ab-8918-cfc842f9c9e8 1073741824 Jul 06 21:09:46 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a68518-788c-475e-9797-8b0e1582a373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aa5d3b4-146f-40a4-b69b-43abecd3f030', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:46 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394e3d3c-843e-43e7-859f-b68cb2daa866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:47 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Volume volume-9aa5d3b4-146f-40a4-b69b-43abecd3f030 (9aa5d3b4-146f-40a4-b69b-43abecd3f030): created successfully Jul 06 21:09:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394e3d3c-843e-43e7-859f-b68cb2daa866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Flow 'volume_create_manager' (8015470f-ff94-404c-b5fd-72e84ec9d36c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:47 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-1c01805e-09c6-409b-a579-12246d4fce07 tempest-CinderUnicodeTest-1728692130 None] Created volume successfully. Jul 06 21:09:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97f28ff-4b50-4f6e-bb0d-f101ae73737f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dc3c4493-17c5-4cd3-8957-655701a9b2fb', 'volume_name': 'volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb', 'volume_size': 1, 'image_id': 'b27a0245-6b5b-4305-a39c-13c60f402bb8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b27a0245-6b5b-4305-a39c-13c60f402bb8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bbe12033d017a817159948229d653a45', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd39090fff3da497d80870038d6023d06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ad15104c7254cd01b5d930a33b5a43436d39278e174570be8e0f4d5a43145144026839ed125e1aa1dea95a75618f1ccffba948fa7588702170d53768ecf6af8', 'id': 'b27a0245-6b5b-4305-a39c-13c60f402bb8', 'created_at': datetime.datetime(2026, 7, 6, 19, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b27a0245-6b5b-4305-a39c-13c60f402bb8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c601a4-cf68-4278-9f38-b4ee7a14e658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c601a4-cf68-4278-9f38-b4ee7a14e658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f131ff2-ee22-4835-aebc-00ef156371d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:47 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Volume dc3c4493-17c5-4cd3-8957-655701a9b2fb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb', 'volume_size': 1, 'image_id': 'b27a0245-6b5b-4305-a39c-13c60f402bb8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b27a0245-6b5b-4305-a39c-13c60f402bb8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bbe12033d017a817159948229d653a45', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd39090fff3da497d80870038d6023d06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ad15104c7254cd01b5d930a33b5a43436d39278e174570be8e0f4d5a43145144026839ed125e1aa1dea95a75618f1ccffba948fa7588702170d53768ecf6af8', 'id': 'b27a0245-6b5b-4305-a39c-13c60f402bb8', 'created_at': datetime.datetime(2026, 7, 6, 19, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b27a0245-6b5b-4305-a39c-13c60f402bb8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 06 21:09:47 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Trying to clone dc3c4493-17c5-4cd3-8957-655701a9b2fb from image b27a0245-6b5b-4305-a39c-13c60f402bb8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b27a0245-6b5b-4305-a39c-13c60f402bb8', 'metadata': {}}]). {{(pid=87207) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 21:09:47 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 21:09:47 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Image download 0.00 MB at 0.00 MB/s Jul 06 21:09:47 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74c1919-2a21-4049-9d3f-01d34cf16d9e]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:47 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD Jul 06 21:09:47 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:47 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD" returned: 0 in 0.957s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:47 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD Jul 06 21:09:47 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:47 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c152e8e4-b596-43ab-8918-cfc842f9c9e8 1073741824" returned: 0 in 0.845s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c152e8e4-b596-43ab-8918-cfc842f9c9e8 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:47 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c152e8e4-b596-43ab-8918-cfc842f9c9e8 Jul 06 21:09:47 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:48 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD" returned: 0 in 0.812s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:48 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD Jul 06 21:09:48 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Flow 'volume_create_manager' (579f7e00-dc54-48d9-96ae-01f1a6e560ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa12c04-bcae-46d2-a8b8-d066e185e6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa12c04-bcae-46d2-a8b8-d066e185e6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1382325872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6acb6e3-7766-4cb6-b86d-449f4405f399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3a8656264d42288a71dd13519e8afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:48Z,use_quota=True,user_id='6d47959787b34e2cabc5c564c8e8130a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5da31a-9273-419b-8ee3-4b8bc26903f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5da31a-9273-419b-8ee3-4b8bc26903f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e908fab9-94ef-48a3-aa16-68ffd719dd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e908fab9-94ef-48a3-aa16-68ffd719dd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6acb6e3-7766-4cb6-b86d-449f4405f399', 'volume_name': 'volume-f6acb6e3-7766-4cb6-b86d-449f4405f399', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c8e5fe-3428-4fe7-be56-c6ef8df7dc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c8e5fe-3428-4fe7-be56-c6ef8df7dc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef660a4-b152-42e7-883e-a5d3ff43d857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:48 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Volume f6acb6e3-7766-4cb6-b86d-449f4405f399: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6acb6e3-7766-4cb6-b86d-449f4405f399', 'volume_size': 1} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:48 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD" returned: 1 in 0.995s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Temporary image ab435561-96c1-4587-b842-8117cafb6854 is fetched for user 4bc385d1fa744492a186dae6fdd86e1a. {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[46097819-179f-4c19-ab52-d89df5cb673b]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:48 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD Jul 06 21:09:48 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:48 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c152e8e4-b596-43ab-8918-cfc842f9c9e8" returned: 0 in 0.850s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.483s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1414742107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc3f511-98d0-4d62-8e83-ee6993a5b3bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3ab1a2e04242cd99d99e59747d302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:43Z,use_quota=True,user_id='ac5b5eecaff444d4adcb4f2dc73a6040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Creating volume 3fc3f511-98d0-4d62-8e83-ee6993a5b3bc {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:09:48 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:48 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc 1073741824 Jul 06 21:09:48 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ccc0d3-8999-411d-9dae-bca70b4ce1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c152e8e4-b596-43ab-8918-cfc842f9c9e8', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7388cc68-4609-42bd-a2d0-74bbb02b1c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:48 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Volume volume-c152e8e4-b596-43ab-8918-cfc842f9c9e8 (c152e8e4-b596-43ab-8918-cfc842f9c9e8): created successfully Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7388cc68-4609-42bd-a2d0-74bbb02b1c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Flow 'volume_create_manager' (8e68c11b-6cef-43da-9fec-7f8015dcd585) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:48 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD" returned: 1 in 0.768s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Temporary image b27a0245-6b5b-4305-a39c-13c60f402bb8 is fetched for user 9d3dc80915b4428a807268d2f10c0ac4. {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 21:09:48 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-1c9bd872-2723-485f-83ea-2f1f093db22d tempest-CreateVolumesFromImageTest-351969944 None] Created volume successfully. Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bed769-1876-4fa4-a97f-82a86ec60f7e]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:49 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD Jul 06 21:09:49 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:49 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:49 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD Jul 06 21:09:49 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:49 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc 1073741824" returned: 0 in 0.915s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:49 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD" returned: 0 in 0.793s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:49 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc Jul 06 21:09:49 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:49 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD Jul 06 21:09:49 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:50 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD" returned: 1 in 0.788s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:50 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:50 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD" returned: 1 in 0.722s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc" returned: 0 in 0.739s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.851s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1445918111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3ab1a2e04242cd99d99e59747d302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:43Z,use_quota=True,user_id='ac5b5eecaff444d4adcb4f2dc73a6040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Creating volume bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:09:50 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfd8a25-02bf-40ac-9fc0-a84dfc80458b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:50 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07 1073741824 Jul 06 21:09:50 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff37c4d-a0a3-423e-bbe3-b6e3a9ed4acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:50 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Volume volume-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc (3fc3f511-98d0-4d62-8e83-ee6993a5b3bc): created successfully Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff37c4d-a0a3-423e-bbe3-b6e3a9ed4acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Flow 'volume_create_manager' (d927f3ad-2c37-4837-8a75-c2e44938c23c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:50 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-7fb10d05-fadd-464b-ac23-e0b9f51164cf tempest-CreateVolumesFromImageTest-351969944 None] Created volume successfully. Jul 06 21:09:51 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07 1073741824" returned: 0 in 0.800s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:51 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07 Jul 06 21:09:51 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:51 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07" returned: 0 in 0.644s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.832s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2107401037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4fb03b-789a-439f-a17d-fec38b9f5adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3ab1a2e04242cd99d99e59747d302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:44Z,use_quota=True,user_id='ac5b5eecaff444d4adcb4f2dc73a6040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Creating volume 4b4fb03b-789a-439f-a17d-fec38b9f5adc {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:09:51 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b4fb03b-789a-439f-a17d-fec38b9f5adc 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:51 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b4fb03b-789a-439f-a17d-fec38b9f5adc 1073741824 Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8be99f-cd9d-4743-bf47-4ece64443610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:51 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc9c2b3-a018-4e5d-b065-de91007652eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:51 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Volume volume-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07 (bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07): created successfully Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc9c2b3-a018-4e5d-b065-de91007652eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:51 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Flow 'volume_create_manager' (36e244c3-cc27-4b87-99fb-d4568602ecbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:51 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-59533f5f-2cef-4a5b-a1c7-a56caf7b163a tempest-CreateVolumesFromImageTest-351969944 None] Created volume successfully. Jul 06 21:09:52 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b4fb03b-789a-439f-a17d-fec38b9f5adc 1073741824" returned: 0 in 0.779s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b4fb03b-789a-439f-a17d-fec38b9f5adc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:52 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b4fb03b-789a-439f-a17d-fec38b9f5adc Jul 06 21:09:52 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:53 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b4fb03b-789a-439f-a17d-fec38b9f5adc" returned: 0 in 0.620s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.995s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1382325872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6acb6e3-7766-4cb6-b86d-449f4405f399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3a8656264d42288a71dd13519e8afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:48Z,use_quota=True,user_id='6d47959787b34e2cabc5c564c8e8130a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Creating volume f6acb6e3-7766-4cb6-b86d-449f4405f399 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:09:53 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6debccc3-1262-4653-8018-78972b246ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b4fb03b-789a-439f-a17d-fec38b9f5adc', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5069f175-df22-449b-ab64-2f8fc48ffdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:53 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399 1073741824 Jul 06 21:09:53 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:53 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Volume volume-4b4fb03b-789a-439f-a17d-fec38b9f5adc (4b4fb03b-789a-439f-a17d-fec38b9f5adc): created successfully Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5069f175-df22-449b-ab64-2f8fc48ffdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Flow 'volume_create_manager' (4f3566f2-ecf8-4729-8029-5e5215ca77f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:53 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-5c7a30b7-160a-45ec-9b1f-bb4f9801cc43 tempest-CreateVolumesFromImageTest-351969944 None] Created volume successfully. Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "cinder-4b4fb03b-789a-439f-a17d-fec38b9f5adc-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-4b4fb03b-789a-439f-a17d-fec38b9f5adc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "cinder-quobyte-4b4fb03b-789a-439f-a17d-fec38b9f5adc" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-quobyte-4b4fb03b-789a-439f-a17d-fec38b9f5adc" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b59f589-6e63-49c3-90aa-282cd89256b3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b4fb03b-789a-439f-a17d-fec38b9f5adc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:54 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b4fb03b-789a-439f-a17d-fec38b9f5adc Jul 06 21:09:54 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:54 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399 1073741824" returned: 0 in 0.803s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:54 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399 Jul 06 21:09:54 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:54 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b4fb03b-789a-439f-a17d-fec38b9f5adc" returned: 0 in 0.789s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b4fb03b-789a-439f-a17d-fec38b9f5adc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:54 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b4fb03b-789a-439f-a17d-fec38b9f5adc Jul 06 21:09:54 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:54 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399" returned: 0 in 0.684s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.852s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6611c7a-1447-44ea-bdb2-bd4fd5e82b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c39dd1b8be4479f88eb79dbe852d4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:46Z,use_quota=True,user_id='4bc385d1fa744492a186dae6fdd86e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Creating volume e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:09:54 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:54 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 1073741824 Jul 06 21:09:54 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef660a4-b152-42e7-883e-a5d3ff43d857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6acb6e3-7766-4cb6-b86d-449f4405f399', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a405771d-469b-4f56-82fd-693e14af839f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:54 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Volume volume-f6acb6e3-7766-4cb6-b86d-449f4405f399 (f6acb6e3-7766-4cb6-b86d-449f4405f399): created successfully Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a405771d-469b-4f56-82fd-693e14af839f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Flow 'volume_create_manager' (579f7e00-dc54-48d9-96ae-01f1a6e560ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:54 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f21473de-1c9b-4d7e-8f1b-e4e33a0b7b46 tempest-CinderUnicodeTest-1728692130 None] Created volume successfully. Jul 06 21:09:55 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4b4fb03b-789a-439f-a17d-fec38b9f5adc" returned: 0 in 0.642s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-quobyte-4b4fb03b-789a-439f-a17d-fec38b9f5adc" released by "delete_volume" :: held 1.472s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:55 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] Created reservations ['2a938c08-c212-435e-88a7-12627ef19dfa', 'c2e70a81-ebe3-4d93-b34c-bd0055471ede', '05b3626f-ac33-4c5c-9b63-593704ed8d2f', '1265cfad-2f3d-4857-b015-bcbae7824e68'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:09:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:55 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:55 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:09:55 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:55 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 1073741824" returned: 0 in 0.877s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:55 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 Jul 06 21:09:55 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "cinder-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "cinder-quobyte-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-quobyte-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07" acquired by "delete_volume" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b1aad5-e438-480b-8ebd-f1a52ec8623f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:56 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.705s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:56 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] Deleted volume successfully. Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-48490ba0-4102-4562-b954-fb9a83bee91f tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-4b4fb03b-789a-439f-a17d-fec38b9f5adc-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:56 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07 Jul 06 21:09:56 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:56 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09" returned: 0 in 0.686s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.122s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3c4493-17c5-4cd3-8957-655701a9b2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39090fff3da497d80870038d6023d06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:46Z,use_quota=True,user_id='9d3dc80915b4428a807268d2f10c0ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6baec08a-7a56-4f1c-bbe3-bf50ab1912f3),volume_type_id=6baec08a-7a56-4f1c-bbe3-bf50ab1912f3)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Creating volume dc3c4493-17c5-4cd3-8957-655701a9b2fb {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:09:56 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:56 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb 1073741824 Jul 06 21:09:56 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Attempting download of ab435561-96c1-4587-b842-8117cafb6854 ((None, [{'url': 'file:///opt/stack/data/glance/images/ab435561-96c1-4587-b842-8117cafb6854', 'metadata': {}}])) to volume e6611c7a-1447-44ea-bdb2-bd4fd5e82b09. {{(pid=87207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2737aab5-e55e-4fe8-abd4-4e5a7e7c5d29]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab435561-96c1-4587-b842-8117cafb6854_1xy4o9br {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:56 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab435561-96c1-4587-b842-8117cafb6854_1xy4o9br Jul 06 21:09:56 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:56 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07" returned: 0 in 0.802s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:57 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07 Jul 06 21:09:57 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:57 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab435561-96c1-4587-b842-8117cafb6854_1xy4o9br" returned: 0 in 0.732s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab435561-96c1-4587-b842-8117cafb6854_1xy4o9br {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:57 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb 1073741824" returned: 0 in 0.884s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:57 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab435561-96c1-4587-b842-8117cafb6854_1xy4o9br Jul 06 21:09:57 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:57 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb Jul 06 21:09:57 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:57 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07" returned: 0 in 0.676s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-quobyte-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07" released by "delete_volume" :: held 1.523s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:57 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] Created reservations ['8f384401-1481-48b1-b13f-74660eec2871', '9f1a794b-fb64-4064-92f9-a5a05b2a6017', '10c674db-153c-4500-bc7c-9253e0914874', '77013262-bb9c-416e-b658-debd1c635b99'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:09:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:57 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:09:57 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:58 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:09:58 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:58 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb" returned: 0 in 0.659s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:58 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.250s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab435561-96c1-4587-b842-8117cafb6854_1xy4o9br" returned: 1 in 0.778s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab435561-96c1-4587-b842-8117cafb6854_1xy4o9br' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6598cf8a-6409-4c90-977f-1f3da5e77770]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] Creating offline snapshot 53884f26-4584-4196-bf47-65a223b7e6df of volume f6acb6e3-7766-4cb6-b86d-449f4405f399 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Attempting download of b27a0245-6b5b-4305-a39c-13c60f402bb8 ((None, [{'url': 'file:///opt/stack/data/glance/images/b27a0245-6b5b-4305-a39c-13c60f402bb8', 'metadata': {}}])) to volume dc3c4493-17c5-4cd3-8957-655701a9b2fb. {{(pid=87207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8b0faf-1b7c-4120-bcbf-7c1e4fa7b32f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd56bf6-f0ed-41c7-bc07-775b08d0b155]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b27a0245-6b5b-4305-a39c-13c60f402bb8_rkfv5eni {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:58 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD Jul 06 21:09:58 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:58 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399 Jul 06 21:09:58 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "cinder-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:58 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b27a0245-6b5b-4305-a39c-13c60f402bb8_rkfv5eni Jul 06 21:09:58 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "cinder-quobyte-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-quobyte-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc" acquired by "delete_volume" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68dba47-ee49-4a2f-97f0-41715736cbd3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:58 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc Jul 06 21:09:58 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:58 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.107s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:58 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] Deleted volume successfully. Jul 06 21:09:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d4e6328d-d94d-4718-a78f-0ad0adbd7af7 tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-bfe8a5eb-3a82-4e9f-bb85-5bf07f03be07-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:59 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD" returned: 0 in 1.063s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:59 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.221s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:59 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:59 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:09:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 28 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:09:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:09:59 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:59 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399" returned: 0 in 1.124s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b27a0245-6b5b-4305-a39c-13c60f402bb8_rkfv5eni" returned: 0 in 1.031s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b27a0245-6b5b-4305-a39c-13c60f402bb8_rkfv5eni {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:59 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df 1G Jul 06 21:09:59 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:59 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD Jul 06 21:09:59 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:59 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b27a0245-6b5b-4305-a39c-13c60f402bb8_rkfv5eni Jul 06 21:09:59 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:59 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc" returned: 0 in 1.066s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:59 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc Jul 06 21:09:59 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:00 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD" returned: 1 in 0.817s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] ab435561-96c1-4587-b842-8117cafb6854 was raw, converting to raw {{(pid=87207) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:00 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 Jul 06 21:10:00 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:00 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b27a0245-6b5b-4305-a39c-13c60f402bb8_rkfv5eni" returned: 1 in 0.792s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b27a0245-6b5b-4305-a39c-13c60f402bb8_rkfv5eni' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ebd8e1-7e2f-42ad-b595-880d66dc817e]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:00 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD Jul 06 21:10:00 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:00 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df 1G" returned: 0 in 0.964s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6acb6e3-7766-4cb6-b86d-449f4405f399 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:00 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6acb6e3-7766-4cb6-b86d-449f4405f399 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df Jul 06 21:10:00 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:00 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc" returned: 0 in 0.727s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-quobyte-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc" released by "delete_volume" :: held 1.902s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] Created reservations ['bcd91174-3556-477c-aee6-b875e8c4f1b6', '39c20c7f-b344-4f35-9dbb-405445fcba2f', '00bf79ca-b909-487f-8f36-497f5a7c2c06', 'be89c1ff-bfbb-4091-9042-44c8cc41a8d9'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:00 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:00 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "cinder-c152e8e4-b596-43ab-8918-cfc842f9c9e8-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-c152e8e4-b596-43ab-8918-cfc842f9c9e8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "cinder-quobyte-c152e8e4-b596-43ab-8918-cfc842f9c9e8" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-quobyte-c152e8e4-b596-43ab-8918-cfc842f9c9e8" acquired by "delete_volume" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd952f4-7c04-4270-82b8-70ca32870e6a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c152e8e4-b596-43ab-8918-cfc842f9c9e8 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:01 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c152e8e4-b596-43ab-8918-cfc842f9c9e8 Jul 06 21:10:01 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:01 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09" returned: 0 in 1.048s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:01 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ab435561-96c1-4587-b842-8117cafb6854_djgp6lopdevstack@QuobyteHD, size 0.00 MB, duration 1.05 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:10:01 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 21:10:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:01 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD" returned: 0 in 1.028s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:01 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 1G Jul 06 21:10:01 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:01 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6acb6e3-7766-4cb6-b86d-449f4405f399 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df" returned: 0 in 0.943s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:01 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df is being set with open permissions: ugo+rw Jul 06 21:10:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:01 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df Jul 06 21:10:01 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:01 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD Jul 06 21:10:01 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:01 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.833s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:01 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:01 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] Deleted volume successfully. Jul 06 21:10:01 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-46746270-ddb9-4b8b-85b9-02f646f46162 tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-3fc3f511-98d0-4d62-8e83-ee6993a5b3bc-delete_volume" released by "delete_volume" :: held 3.051s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:01 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c152e8e4-b596-43ab-8918-cfc842f9c9e8" returned: 0 in 1.054s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c152e8e4-b596-43ab-8918-cfc842f9c9e8 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:02 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c152e8e4-b596-43ab-8918-cfc842f9c9e8 Jul 06 21:10:02 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:02 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 1G" returned: 0 in 0.964s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:02 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df" returned: 0 in 0.870s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[abed8408-c2a7-4923-b23d-a0577981bb1c]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:02 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD" returned: 1 in 0.996s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] b27a0245-6b5b-4305-a39c-13c60f402bb8 was raw, converting to raw {{(pid=87207) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:02 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb Jul 06 21:10:02 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:02 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.info Jul 06 21:10:02 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:02 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 Jul 06 21:10:02 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:02 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c152e8e4-b596-43ab-8918-cfc842f9c9e8" returned: 0 in 0.708s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-quobyte-c152e8e4-b596-43ab-8918-cfc842f9c9e8" released by "delete_volume" :: held 1.815s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] Created reservations ['d2c84704-e420-444a-b081-e7fcb7c59537', '3d7331ea-a916-4e20-848a-2768f5fdfbdc', '957f23c7-763e-4989-ac94-4e8c8f2498b6', '48c1324f-ad0c-4532-b227-05cafa8ca823'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:02 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:02 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:02 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.info" returned: 0 in 0.808s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:02 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.info is being set with open permissions: ugo+rw Jul 06 21:10:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:03 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb" returned: 0 in 0.849s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:03 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b27a0245-6b5b-4305-a39c-13c60f402bb8_k83fycpudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:10:03 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 21:10:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:03 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.info Jul 06 21:10:03 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:03 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb 1G Jul 06 21:10:03 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:03 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09" returned: 0 in 0.997s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "cinder-adfd1324-dce3-47b2-9574-ddbc9378e80b-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-adfd1324-dce3-47b2-9574-ddbc9378e80b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "cinder-quobyte-adfd1324-dce3-47b2-9574-ddbc9378e80b" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:03 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 Jul 06 21:10:03 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-quobyte-adfd1324-dce3-47b2-9574-ddbc9378e80b" acquired by "delete_volume" :: waited 0.034s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:03 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[bace173d-603b-4af9-8260-22be51e6f82c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-adfd1324-dce3-47b2-9574-ddbc9378e80b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:03 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-adfd1324-dce3-47b2-9574-ddbc9378e80b Jul 06 21:10:03 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:03 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.049s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:03 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:03 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] Deleted volume successfully. Jul 06 21:10:03 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.info" returned: 0 in 0.942s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.821s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:03 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cc99d003-c089-434c-a74b-04ce2ae2e9ed tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-c152e8e4-b596-43ab-8918-cfc842f9c9e8-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:03 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-16de9d8b-ae67-4274-9994-05aec348d429 tempest-CinderUnicodeTest-1728692130 None] Create snapshot completed successfully Jul 06 21:10:04 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09" returned: 1 in 0.978s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Downloaded image ab435561-96c1-4587-b842-8117cafb6854 ((None, [{'url': 'file:///opt/stack/data/glance/images/ab435561-96c1-4587-b842-8117cafb6854', 'metadata': {}}])) to volume e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 successfully. {{(pid=87207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Temporary image ab435561-96c1-4587-b842-8117cafb6854 for user 4bc385d1fa744492a186dae6fdd86e1a is deleted. {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Marking volume e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 as bootable. {{(pid=87207) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Copying metadata from image ab435561-96c1-4587-b842-8117cafb6854 to e6611c7a-1447-44ea-bdb2-bd4fd5e82b09. {{(pid=87207) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Creating volume glance metadata for volume e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 backed by image ab435561-96c1-4587-b842-8117cafb6854 with: {'image_id': 'ab435561-96c1-4587-b842-8117cafb6854', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ee2e0098cc372b60ba86685306c002b1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87207) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 21:10:04 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb 1G" returned: 0 in 1.125s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[684cdc13-7519-4d53-b9fb-6c6f39aa5f05]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a8f6f54-3ccd-4fb7-bb2d-7d61cfc65693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09', 'volume_size': 1, 'image_id': 'ab435561-96c1-4587-b842-8117cafb6854', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab435561-96c1-4587-b842-8117cafb6854', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ee2e0098cc372b60ba86685306c002b1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7c39dd1b8be4479f88eb79dbe852d4bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c9a600d4e5950952e2aebdaafbf318d891e034871e63eca4b13a4c784bb591f4b987047bbf15a7e76f7e24d1283d60516610c836488b4ba3f88bd58f6db9b51b', 'id': 'ab435561-96c1-4587-b842-8117cafb6854', 'created_at': datetime.datetime(2026, 7, 6, 19, 9, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 9, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab435561-96c1-4587-b842-8117cafb6854/file', 'properties': {}}, 'image_service': }' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c4af37-6e85-4f4f-8290-a1b2b3804cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:04 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Volume volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 (e6611c7a-1447-44ea-bdb2-bd4fd5e82b09): created successfully Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c4af37-6e85-4f4f-8290-a1b2b3804cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Flow 'volume_create_manager' (7fbae94c-3092-4493-bb46-a82d10b04e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:04 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-9eb494aa-09a6-4ddf-8dd2-fd4ece30ac49 tempest-VolumeImageDependencyTests-885609646 None] Created volume successfully. Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] Acquiring lock "cinder-53884f26-4584-4196-bf47-65a223b7e6df-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:04 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb Jul 06 21:10:04 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] Lock "cinder-53884f26-4584-4196-bf47-65a223b7e6df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] Acquiring lock "cinder-quobyte-f6acb6e3-7766-4cb6-b86d-449f4405f399" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] Lock "cinder-quobyte-f6acb6e3-7766-4cb6-b86d-449f4405f399" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] Acquiring lock "cinder-quobyte-53884f26-4584-4196-bf47-65a223b7e6df" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] Lock "cinder-quobyte-53884f26-4584-4196-bf47-65a223b7e6df" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] Deleting offline snapshot 53884f26-4584-4196-bf47-65a223b7e6df of volume f6acb6e3-7766-4cb6-b86d-449f4405f399 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] snapshot_file for this snap is: volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b58ac8-8e13-4791-b141-9e5685e8aea0]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:04 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-adfd1324-dce3-47b2-9574-ddbc9378e80b" returned: 0 in 1.103s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-adfd1324-dce3-47b2-9574-ddbc9378e80b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:04 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-adfd1324-dce3-47b2-9574-ddbc9378e80b Jul 06 21:10:04 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:04 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df Jul 06 21:10:04 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:05 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb" returned: 0 in 0.834s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:05 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-adfd1324-dce3-47b2-9574-ddbc9378e80b" returned: 0 in 0.675s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:05 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb Jul 06 21:10:05 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-quobyte-adfd1324-dce3-47b2-9574-ddbc9378e80b" released by "delete_volume" :: held 1.854s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] Created reservations ['c8cf9564-634b-4dc3-808c-f8b09032f353', '51cefa3d-3e10-4d6d-933a-93d649d43d4c', 'c596d997-a4f6-40e2-ac81-718d8d8e352e', '9fc2252f-f676-4864-b321-6380df893047'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:05 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df" returned: 0 in 0.799s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6acb6e3-7766-4cb6-b86d-449f4405f399(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a172b5-a638-47e4-bba9-6ffff548131d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:05 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:05 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] Acquiring lock "cinder-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] Lock "cinder-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:05 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399 Jul 06 21:10:05 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] Acquiring lock "cinder-quobyte-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] Lock "cinder-quobyte-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09" acquired by "delete_volume" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa32df6-a6e1-4013-9b3c-88946230b0b5]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:05 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 Jul 06 21:10:05 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:06 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb" returned: 1 in 1.169s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:10:06 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Downloaded image b27a0245-6b5b-4305-a39c-13c60f402bb8 ((None, [{'url': 'file:///opt/stack/data/glance/images/b27a0245-6b5b-4305-a39c-13c60f402bb8', 'metadata': {}}])) to volume dc3c4493-17c5-4cd3-8957-655701a9b2fb successfully. {{(pid=87207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 21:10:06 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Temporary image b27a0245-6b5b-4305-a39c-13c60f402bb8 for user 9d3dc80915b4428a807268d2f10c0ac4 is deleted. {{(pid=87207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 21:10:06 devstack cinder-volume[87207]: DEBUG cinder.volume.volume_utils [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Marking volume dc3c4493-17c5-4cd3-8957-655701a9b2fb as bootable. {{(pid=87207) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 21:10:06 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Copying metadata from image b27a0245-6b5b-4305-a39c-13c60f402bb8 to dc3c4493-17c5-4cd3-8957-655701a9b2fb. {{(pid=87207) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 21:10:06 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Creating volume glance metadata for volume dc3c4493-17c5-4cd3-8957-655701a9b2fb backed by image b27a0245-6b5b-4305-a39c-13c60f402bb8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b27a0245-6b5b-4305-a39c-13c60f402bb8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bbe12033d017a817159948229d653a45', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87207) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 21:10:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f131ff2-ee22-4835-aebc-00ef156371d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb', 'volume_size': 1, 'image_id': 'b27a0245-6b5b-4305-a39c-13c60f402bb8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b27a0245-6b5b-4305-a39c-13c60f402bb8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bbe12033d017a817159948229d653a45', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd39090fff3da497d80870038d6023d06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ad15104c7254cd01b5d930a33b5a43436d39278e174570be8e0f4d5a43145144026839ed125e1aa1dea95a75618f1ccffba948fa7588702170d53768ecf6af8', 'id': 'b27a0245-6b5b-4305-a39c-13c60f402bb8', 'created_at': datetime.datetime(2026, 7, 6, 19, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b27a0245-6b5b-4305-a39c-13c60f402bb8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09f37f5-e44f-41c5-af65-5c46b1df07b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:06 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.001s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:06 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:06 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Volume volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb (dc3c4493-17c5-4cd3-8957-655701a9b2fb): created successfully Jul 06 21:10:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09f37f5-e44f-41c5-af65-5c46b1df07b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:06 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Flow 'volume_create_manager' (f3558779-6712-4d27-9e22-a1d7e3385e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:06 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] Deleted volume successfully. Jul 06 21:10:06 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-af8ec2bc-5656-4629-ba05-6661f77812a0 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Created volume successfully. Jul 06 21:10:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-38e7735f-9e4e-4f42-b9f4-1d066a26efde tempest-CreateVolumesFromImageTest-351969944 None] Lock "cinder-adfd1324-dce3-47b2-9574-ddbc9378e80b-delete_volume" released by "delete_volume" :: held 3.240s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:06 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399" returned: 0 in 1.207s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:06 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df Jul 06 21:10:06 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:06 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09" returned: 0 in 1.043s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:06 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 Jul 06 21:10:06 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Acquiring lock "cinder-dc3c4493-17c5-4cd3-8957-655701a9b2fb-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Lock "cinder-dc3c4493-17c5-4cd3-8957-655701a9b2fb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Acquiring lock "cinder-quobyte-dc3c4493-17c5-4cd3-8957-655701a9b2fb" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Lock "cinder-quobyte-dc3c4493-17c5-4cd3-8957-655701a9b2fb" acquired by "delete_volume" :: waited 0.027s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:07 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[36507cfe-6113-40ab-95e2-55efc7de805e]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:07 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb Jul 06 21:10:07 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:07 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df" returned: 0 in 0.937s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:07 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df Jul 06 21:10:07 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:07 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09" returned: 1 in 0.983s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:10:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:07 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09 Jul 06 21:10:07 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:08 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb" returned: 0 in 0.868s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:08 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb Jul 06 21:10:08 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:08 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399.53884f26-4584-4196-bf47-65a223b7e6df" returned: 0 in 0.803s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] Lock "cinder-quobyte-53884f26-4584-4196-bf47-65a223b7e6df" released by "_delete_snapshot" :: held 3.895s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] Lock "cinder-quobyte-f6acb6e3-7766-4cb6-b86d-449f4405f399" released by "delete_snapshot" :: held 3.924s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] Created reservations ['3fbc1a6d-52c1-4ec4-9fad-8cafe9240a94', 'f72d4267-5fd2-4a59-bb7d-22c7f2987c15', 'ba2a5a50-9dc8-4a9d-b320-81bd3d06b041', 'a7b26934-6dff-488f-bd49-d0597ab73adf'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:08 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] Delete snapshot completed successfully. Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-83f5b897-3f29-4e7f-8b03-8d17ade246fb tempest-CinderUnicodeTest-1728692130 None] Lock "cinder-53884f26-4584-4196-bf47-65a223b7e6df-delete_snapshot" released by "delete_snapshot" :: held 4.078s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:08 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09" returned: 0 in 0.940s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] Acquiring lock "cinder-f6acb6e3-7766-4cb6-b86d-449f4405f399-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] Lock "cinder-quobyte-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09" released by "delete_volume" :: held 3.072s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] Lock "cinder-f6acb6e3-7766-4cb6-b86d-449f4405f399-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] Acquiring lock "cinder-quobyte-f6acb6e3-7766-4cb6-b86d-449f4405f399" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] Created reservations ['557b19e3-41df-4cd3-b4ce-4388789165ef', '69491d8a-8bd1-4f77-aa2a-1ea31dd5e47c', '62841747-985b-4a45-8f37-48cf5ff23a2f', '604838b6-8619-4d22-956c-1db35ce230b7'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] Lock "cinder-quobyte-f6acb6e3-7766-4cb6-b86d-449f4405f399" acquired by "delete_volume" :: waited 0.026s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[322af8bc-e267-4b88-a165-361caa75c16d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:08 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb" returned: 1 in 0.875s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb' failed. Not Retrying. {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:08 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb Jul 06 21:10:08 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:08 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399 Jul 06 21:10:08 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:09 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:09 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Flow 'volume_create_manager' (f1b41106-0609-4210-bc70-b376e31289ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a253c9e9-8779-4682-a5ad-583937b72fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a253c9e9-8779-4682-a5ad-583937b72fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1860432371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281ee0de-35b2-4299-a5ff-e96cd24aa740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7abc9f6c534e4e5a8670dd9470b80bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:09Z,use_quota=True,user_id='423c401a84094712812df79eeed640fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3f2456-eeb1-42f1-933b-0badcab1712b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3f2456-eeb1-42f1-933b-0badcab1712b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a35b879-e909-4a30-9d29-16a10a09e015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a35b879-e909-4a30-9d29-16a10a09e015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '281ee0de-35b2-4299-a5ff-e96cd24aa740', 'volume_name': 'volume-281ee0de-35b2-4299-a5ff-e96cd24aa740', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe2001b-fb51-4cfa-8449-c5ff9494d98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe2001b-fb51-4cfa-8449-c5ff9494d98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85e1354-3e03-4bd3-92c8-3250024076d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:09 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Volume 281ee0de-35b2-4299-a5ff-e96cd24aa740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-281ee0de-35b2-4299-a5ff-e96cd24aa740', 'volume_size': 1} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1860432371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281ee0de-35b2-4299-a5ff-e96cd24aa740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7abc9f6c534e4e5a8670dd9470b80bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:09Z,use_quota=True,user_id='423c401a84094712812df79eeed640fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Creating volume 281ee0de-35b2-4299-a5ff-e96cd24aa740 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:09 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:09 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740 1073741824 Jul 06 21:10:09 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:09 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.697s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:09 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] Deleted volume successfully. Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5af4dbd5-f45b-4447-b927-a6f64b737c86 tempest-VolumeImageDependencyTests-885609646 None] Lock "cinder-e6611c7a-1447-44ea-bdb2-bd4fd5e82b09-delete_volume" released by "delete_volume" :: held 4.208s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:09 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399" returned: 0 in 0.933s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:09 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399 Jul 06 21:10:09 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:09 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dc3c4493-17c5-4cd3-8957-655701a9b2fb" returned: 0 in 0.900s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Lock "cinder-quobyte-dc3c4493-17c5-4cd3-8957-655701a9b2fb" released by "delete_volume" :: held 2.723s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Created reservations ['9f038952-3915-4104-bbcf-d185f2dbfd4d', '1f3c104f-9e75-4fa8-b15c-c046e0877c78', 'cd80c9d8-6329-4c9c-94f0-f857a88aad20', '2589e004-ab28-4337-8100-474265a63841'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:10 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:10 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:10 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740 1073741824" returned: 0 in 0.919s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:10 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740 Jul 06 21:10:10 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:10 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f6acb6e3-7766-4cb6-b86d-449f4405f399" returned: 0 in 0.850s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] Lock "cinder-quobyte-f6acb6e3-7766-4cb6-b86d-449f4405f399" released by "delete_volume" :: held 1.876s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:10 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] Created reservations ['d66aefb6-1cd4-421e-af3f-2c1526ad6893', '7141d29f-2d09-438c-b586-add3b0de9f90', 'e240cb1e-1867-4d00-bf20-8b9d0cf0e694', '16a4fc09-4b1e-4e73-b9f0-d05e550660db'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:10 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.826s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:10 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:10 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Deleted volume successfully. Jul 06 21:10:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5de541c-45d9-446f-a76c-849afd4a3d08 tempest-VolumeAndVolumeTypeFromImageTest-449274839 None] Lock "cinder-dc3c4493-17c5-4cd3-8957-655701a9b2fb-delete_volume" released by "delete_volume" :: held 3.827s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:10 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:10 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] Acquiring lock "cinder-9aa5d3b4-146f-40a4-b69b-43abecd3f030-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] Lock "cinder-9aa5d3b4-146f-40a4-b69b-43abecd3f030-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] Acquiring lock "cinder-quobyte-9aa5d3b4-146f-40a4-b69b-43abecd3f030" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] Lock "cinder-quobyte-9aa5d3b4-146f-40a4-b69b-43abecd3f030" acquired by "delete_volume" :: waited 0.030s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:11 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7091ed1a-500d-422e-950e-3fdc749ad3c2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9aa5d3b4-146f-40a4-b69b-43abecd3f030 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:11 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9aa5d3b4-146f-40a4-b69b-43abecd3f030 Jul 06 21:10:11 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:11 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740" returned: 0 in 1.019s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:10:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.022s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85e1354-3e03-4bd3-92c8-3250024076d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-281ee0de-35b2-4299-a5ff-e96cd24aa740', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa52894-c6e8-4157-a644-0e1d5d23132d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:11 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Volume volume-281ee0de-35b2-4299-a5ff-e96cd24aa740 (281ee0de-35b2-4299-a5ff-e96cd24aa740): created successfully Jul 06 21:10:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa52894-c6e8-4157-a644-0e1d5d23132d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Flow 'volume_create_manager' (f1b41106-0609-4210-bc70-b376e31289ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:11 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-a73b22e7-6845-4c3d-b592-4214fd6e74d7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Created volume successfully. Jul 06 21:10:11 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.939s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:11 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:11 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] Deleted volume successfully. Jul 06 21:10:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f43cc2d0-1cf2-498a-a9ec-8973fab5a629 tempest-CinderUnicodeTest-1728692130 None] Lock "cinder-f6acb6e3-7766-4cb6-b86d-449f4405f399-delete_volume" released by "delete_volume" :: held 3.149s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:12 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9aa5d3b4-146f-40a4-b69b-43abecd3f030" returned: 0 in 1.089s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9aa5d3b4-146f-40a4-b69b-43abecd3f030 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:12 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9aa5d3b4-146f-40a4-b69b-43abecd3f030 Jul 06 21:10:12 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Creating offline snapshot 1b21faeb-a081-4f1b-946e-74f2bf8af14d of volume 281ee0de-35b2-4299-a5ff-e96cd24aa740 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:10:12 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[69433886-2b69-4b19-bcde-09bfc96964b9]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:13 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740 Jul 06 21:10:13 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:13 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-9aa5d3b4-146f-40a4-b69b-43abecd3f030" returned: 0 in 0.924s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:13 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] Lock "cinder-quobyte-9aa5d3b4-146f-40a4-b69b-43abecd3f030" released by "delete_volume" :: held 2.071s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:13 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] Created reservations ['98c7a5e9-5c60-456f-bf2c-bc6b26afff19', 'c0325f50-1fd1-4bcb-86b9-5a9d83207b76', 'e4fd78bb-d559-454d-8937-ffc0ee037c42', 'f789b8d0-d2d2-410c-baa6-fb22888081f5'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:13 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:13 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:13 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:13 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740" returned: 0 in 1.042s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:13 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d 1G Jul 06 21:10:13 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:14 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.774s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:14 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:14 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] Deleted volume successfully. Jul 06 21:10:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-4c0b9830-e51c-43bd-a355-6f0eef97c261 tempest-CinderUnicodeTest-1728692130 None] Lock "cinder-9aa5d3b4-146f-40a4-b69b-43abecd3f030-delete_volume" released by "delete_volume" :: held 3.168s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:14 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d 1G" returned: 0 in 0.941s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-281ee0de-35b2-4299-a5ff-e96cd24aa740 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:14 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-281ee0de-35b2-4299-a5ff-e96cd24aa740 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d Jul 06 21:10:14 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:14 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-944cc785-1e5e-4ccc-94f6-9d13f4b05bc4 tempest-ProjectAdminTests-2015115589 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87207) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 21:10:15 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-281ee0de-35b2-4299-a5ff-e96cd24aa740 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d" returned: 0 in 0.822s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:15 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d is being set with open permissions: ugo+rw Jul 06 21:10:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:15 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d Jul 06 21:10:15 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:16 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d" returned: 0 in 0.773s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:16 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.info Jul 06 21:10:16 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:16 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Flow 'volume_create_manager' (45f6ee37-c572-479f-b716-5c26e83814bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bffbc9df-bbda-48ba-bfcf-8b105a976037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bffbc9df-bbda-48ba-bfcf-8b105a976037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-873655555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7583327e-5d8a-40da-a197-ea8c94ec8513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f83f52546141e0b43acc5853ca266f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:17Z,use_quota=True,user_id='306bd9aa81804a22955358e37faf3de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35c6737-91e9-4537-9cdf-6c0cce36db65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35c6737-91e9-4537-9cdf-6c0cce36db65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d0feb6b-9274-40b2-a97a-43fdd7c5ba32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d0feb6b-9274-40b2-a97a-43fdd7c5ba32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7583327e-5d8a-40da-a197-ea8c94ec8513', 'volume_name': 'volume-7583327e-5d8a-40da-a197-ea8c94ec8513', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff8fb50-850a-4f0b-88d8-c78a5d345f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:16 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff8fb50-850a-4f0b-88d8-c78a5d345f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1822c0-d4f5-4e38-a1d3-a7d437ecc941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:17 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Volume 7583327e-5d8a-40da-a197-ea8c94ec8513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7583327e-5d8a-40da-a197-ea8c94ec8513', 'volume_size': 1} Jul 06 21:10:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:17 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.info" returned: 0 in 0.968s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:17 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.info is being set with open permissions: ugo+rw Jul 06 21:10:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:17 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.info Jul 06 21:10:17 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:18 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.info" returned: 0 in 0.647s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.353s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.162s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-873655555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7583327e-5d8a-40da-a197-ea8c94ec8513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f83f52546141e0b43acc5853ca266f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:17Z,use_quota=True,user_id='306bd9aa81804a22955358e37faf3de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Creating volume 7583327e-5d8a-40da-a197-ea8c94ec8513 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:18 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:10:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7583327e-5d8a-40da-a197-ea8c94ec8513 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:18 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7583327e-5d8a-40da-a197-ea8c94ec8513 1073741824 Jul 06 21:10:18 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:18 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-31848f93-c2d9-4436-849c-0ad1274db76a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Create snapshot completed successfully Jul 06 21:10:19 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7583327e-5d8a-40da-a197-ea8c94ec8513 1073741824" returned: 0 in 0.912s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7583327e-5d8a-40da-a197-ea8c94ec8513 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:19 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7583327e-5d8a-40da-a197-ea8c94ec8513 Jul 06 21:10:19 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Flow 'volume_create_manager' (670ae784-ac0f-4eea-a219-efa014cadc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2bfeb87-a553-4d37-a153-31929477fce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2bfeb87-a553-4d37-a153-31929477fce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1702849312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fff8fb2-88bf-4c16-a74d-aea9c551adff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7abc9f6c534e4e5a8670dd9470b80bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:20Z,use_quota=True,user_id='423c401a84094712812df79eeed640fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb32d96d-de7f-4d32-a9ab-2cedac44becf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb32d96d-de7f-4d32-a9ab-2cedac44becf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (653bfc25-19da-49e8-857b-a40a3592827d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (653bfc25-19da-49e8-857b-a40a3592827d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fff8fb2-88bf-4c16-a74d-aea9c551adff', 'volume_name': 'volume-0fff8fb2-88bf-4c16-a74d-aea9c551adff', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9adf4631-3f97-4018-bdc9-5ce0c328e261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9adf4631-3f97-4018-bdc9-5ce0c328e261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d26e065-a1b7-4eb2-bb2c-703d68caa66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:19 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Volume 0fff8fb2-88bf-4c16-a74d-aea9c551adff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fff8fb2-88bf-4c16-a74d-aea9c551adff', 'volume_size': 1} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:19 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7583327e-5d8a-40da-a197-ea8c94ec8513" returned: 0 in 0.781s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.145s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1702849312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fff8fb2-88bf-4c16-a74d-aea9c551adff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7abc9f6c534e4e5a8670dd9470b80bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:20Z,use_quota=True,user_id='423c401a84094712812df79eeed640fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Creating volume 0fff8fb2-88bf-4c16-a74d-aea9c551adff {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:19 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0fff8fb2-88bf-4c16-a74d-aea9c551adff 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1822c0-d4f5-4e38-a1d3-a7d437ecc941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7583327e-5d8a-40da-a197-ea8c94ec8513', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:19 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0fff8fb2-88bf-4c16-a74d-aea9c551adff 1073741824 Jul 06 21:10:19 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc781882-38a3-4628-959a-9c81c80148a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:20 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Volume volume-7583327e-5d8a-40da-a197-ea8c94ec8513 (7583327e-5d8a-40da-a197-ea8c94ec8513): created successfully Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc781882-38a3-4628-959a-9c81c80148a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Flow 'volume_create_manager' (45f6ee37-c572-479f-b716-5c26e83814bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:20 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-3541e72f-f6eb-43eb-aad3-16b4e856bcf3 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Created volume successfully. Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Flow 'volume_create_manager' (afc28a20-4f93-4d81-a143-df7baedc6b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82d06d7-3324-4eb7-94e1-828d2f5c447b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82d06d7-3324-4eb7-94e1-828d2f5c447b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1726424964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3548918-0a42-4269-8937-aeff769ecb6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7abc9f6c534e4e5a8670dd9470b80bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:20Z,use_quota=True,user_id='423c401a84094712812df79eeed640fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddeeeccf-54ee-4335-b082-8f9e3052572c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddeeeccf-54ee-4335-b082-8f9e3052572c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d2673d-c2c9-497a-b2c2-f58434459ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d2673d-c2c9-497a-b2c2-f58434459ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3548918-0a42-4269-8937-aeff769ecb6b', 'volume_name': 'volume-d3548918-0a42-4269-8937-aeff769ecb6b', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27841efc-c3f2-4fdd-84ab-229f273b9e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27841efc-c3f2-4fdd-84ab-229f273b9e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1736aa-e948-43c1-bff9-e9ed78fdcde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:20 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Volume d3548918-0a42-4269-8937-aeff769ecb6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3548918-0a42-4269-8937-aeff769ecb6b', 'volume_size': 1} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Flow 'volume_create_manager' (2807d910-a936-4205-84d6-8316187be728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8a07ea-1669-4207-bcb5-a983dce82377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8a07ea-1669-4207-bcb5-a983dce82377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-120818651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e3d15d3-e48f-4547-a455-7f89791ec319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7abc9f6c534e4e5a8670dd9470b80bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:21Z,use_quota=True,user_id='423c401a84094712812df79eeed640fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (284db602-70f4-4c19-92d6-e84d2191ef25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (284db602-70f4-4c19-92d6-e84d2191ef25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ebe572c-2655-4b05-b05a-25c4eb13144b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ebe572c-2655-4b05-b05a-25c4eb13144b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e3d15d3-e48f-4547-a455-7f89791ec319', 'volume_name': 'volume-0e3d15d3-e48f-4547-a455-7f89791ec319', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d386a682-f1f2-44cb-b9c6-f2b57e11133f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d386a682-f1f2-44cb-b9c6-f2b57e11133f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db382cf-f647-420b-b1dc-85ff160a10b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:20 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Volume 0e3d15d3-e48f-4547-a455-7f89791ec319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e3d15d3-e48f-4547-a455-7f89791ec319', 'volume_size': 1} Jul 06 21:10:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:21 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0fff8fb2-88bf-4c16-a74d-aea9c551adff 1073741824" returned: 0 in 1.358s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Flow 'volume_create_manager' (4e69d6b6-c7ff-4023-931f-0e04e26cd86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089b9522-4fd8-46b6-9459-0ded478e094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0fff8fb2-88bf-4c16-a74d-aea9c551adff {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089b9522-4fd8-46b6-9459-0ded478e094f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1987380869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e094465-b291-422a-ae5f-ade771d7c494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7abc9f6c534e4e5a8670dd9470b80bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:21Z,use_quota=True,user_id='423c401a84094712812df79eeed640fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc74b74a-037a-4191-ac6c-1f1571e1086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc74b74a-037a-4191-ac6c-1f1571e1086e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:21 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0fff8fb2-88bf-4c16-a74d-aea9c551adff Jul 06 21:10:21 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c15474-91db-48ff-b6fe-cebce0c8252d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c15474-91db-48ff-b6fe-cebce0c8252d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e094465-b291-422a-ae5f-ade771d7c494', 'volume_name': 'volume-0e094465-b291-422a-ae5f-ade771d7c494', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2153fd3c-87c0-4c1e-be70-5e706a08f4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2153fd3c-87c0-4c1e-be70-5e706a08f4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f221ad-ca14-4e45-9750-424320d56b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:21 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Volume 0e094465-b291-422a-ae5f-ade771d7c494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e094465-b291-422a-ae5f-ade771d7c494', 'volume_size': 1} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Flow 'volume_create_manager' (75c09dcf-73d2-44f7-b6e6-28abb3841738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f38eee-2c00-4f3c-95ef-e640123f935c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f38eee-2c00-4f3c-95ef-e640123f935c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1281865305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff721718-e0fa-4dbd-a792-dd95ac2c5cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7abc9f6c534e4e5a8670dd9470b80bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:22Z,use_quota=True,user_id='423c401a84094712812df79eeed640fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da090ca6-0c82-4d31-8ed4-6666238e6078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da090ca6-0c82-4d31-8ed4-6666238e6078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92adee60-ea22-4839-8ec8-c289b5637b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92adee60-ea22-4839-8ec8-c289b5637b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff721718-e0fa-4dbd-a792-dd95ac2c5cf8', 'volume_name': 'volume-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22dcf3be-5e2c-4e90-86f3-b96245607791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22dcf3be-5e2c-4e90-86f3-b96245607791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de03760-018b-4d03-a66c-97024d25d306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:21 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Volume ff721718-e0fa-4dbd-a792-dd95ac2c5cf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8', 'volume_size': 1} Jul 06 21:10:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Flow 'volume_create_manager' (f01eac06-d2f3-47d2-8fc1-5f7d87ec30be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf021c0-604c-4607-b553-8055c21d5043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf021c0-604c-4607-b553-8055c21d5043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-207390523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240d6b14-8e9c-4b25-9382-2b711c9f5142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f83f52546141e0b43acc5853ca266f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:22Z,use_quota=True,user_id='306bd9aa81804a22955358e37faf3de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ce0642-ab6d-4327-9d5b-ae371d7e4aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ce0642-ab6d-4327-9d5b-ae371d7e4aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56452f4d-7ba1-4c91-9286-15ed8058b986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56452f4d-7ba1-4c91-9286-15ed8058b986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '240d6b14-8e9c-4b25-9382-2b711c9f5142', 'volume_name': 'volume-240d6b14-8e9c-4b25-9382-2b711c9f5142', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552df435-25ff-4eaa-9735-c62c060ed81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552df435-25ff-4eaa-9735-c62c060ed81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264257eb-54bd-4975-a891-343c571ae266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:22 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Volume 240d6b14-8e9c-4b25-9382-2b711c9f5142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-240d6b14-8e9c-4b25-9382-2b711c9f5142', 'volume_size': 1} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:22 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0fff8fb2-88bf-4c16-a74d-aea9c551adff" returned: 0 in 1.045s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] <== create_volume: return (2500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.506s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.184s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1726424964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3548918-0a42-4269-8937-aeff769ecb6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7abc9f6c534e4e5a8670dd9470b80bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:20Z,use_quota=True,user_id='423c401a84094712812df79eeed640fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Creating volume d3548918-0a42-4269-8937-aeff769ecb6b {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:22 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d3548918-0a42-4269-8937-aeff769ecb6b 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:22 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d3548918-0a42-4269-8937-aeff769ecb6b 1073741824 Jul 06 21:10:22 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d26e065-a1b7-4eb2-bb2c-703d68caa66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fff8fb2-88bf-4c16-a74d-aea9c551adff', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094a6687-a24a-4ba7-8dd3-5325b5db14ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:22 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Volume volume-0fff8fb2-88bf-4c16-a74d-aea9c551adff (0fff8fb2-88bf-4c16-a74d-aea9c551adff): created successfully Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094a6687-a24a-4ba7-8dd3-5325b5db14ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Flow 'volume_create_manager' (670ae784-ac0f-4eea-a219-efa014cadc37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:22 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-6d2bb2f7-b305-48e4-8eb9-2e50050e7865 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Created volume successfully. Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Flow 'volume_create_manager' (51613e9d-db6e-4ebd-bf4d-fb2937463031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50239797-f17a-4f90-b36c-fc1d83fc336a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50239797-f17a-4f90-b36c-fc1d83fc336a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1246005686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40de103c-ff87-41de-a5f7-5f6e20864689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f83f52546141e0b43acc5853ca266f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:23Z,use_quota=True,user_id='306bd9aa81804a22955358e37faf3de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33b1502-52c9-482e-a86e-78c7935be8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33b1502-52c9-482e-a86e-78c7935be8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (210a1ec2-a74f-45ff-b29c-49835f4755bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (210a1ec2-a74f-45ff-b29c-49835f4755bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40de103c-ff87-41de-a5f7-5f6e20864689', 'volume_name': 'volume-40de103c-ff87-41de-a5f7-5f6e20864689', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884e3130-ff33-46c1-b61a-a8cf257ab987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884e3130-ff33-46c1-b61a-a8cf257ab987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b326d9-8995-4d80-8df1-cc6d89dac606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:22 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Volume 40de103c-ff87-41de-a5f7-5f6e20864689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40de103c-ff87-41de-a5f7-5f6e20864689', 'volume_size': 1} Jul 06 21:10:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:23 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Flow 'volume_create_manager' (bc3c83e1-ce17-4def-872a-d8235f707fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f9c69d-e08b-4185-9ea2-6e105f31dee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f9c69d-e08b-4185-9ea2-6e105f31dee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1772706164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9fe136-e0b9-45af-a064-2c5ce55926ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f83f52546141e0b43acc5853ca266f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:23Z,use_quota=True,user_id='306bd9aa81804a22955358e37faf3de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7b6f93-4d8b-4464-b7eb-331872e442e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7b6f93-4d8b-4464-b7eb-331872e442e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f87955-3166-412c-b334-f3a381ea3558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f87955-3166-412c-b334-f3a381ea3558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9fe136-e0b9-45af-a064-2c5ce55926ad', 'volume_name': 'volume-df9fe136-e0b9-45af-a064-2c5ce55926ad', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc57b6bb-8477-4758-b1cb-df8c4de32ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc57b6bb-8477-4758-b1cb-df8c4de32ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924759c4-dbf7-4904-9567-982c3f689007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:23 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Volume df9fe136-e0b9-45af-a064-2c5ce55926ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9fe136-e0b9-45af-a064-2c5ce55926ad', 'volume_size': 1} Jul 06 21:10:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:23 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d3548918-0a42-4269-8937-aeff769ecb6b 1073741824" returned: 0 in 1.517s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:23 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:23 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Flow 'volume_create_manager' (99f1c35c-c4a7-427e-97e3-246e62b38936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd4dd12-5115-4816-bfb7-bfcbdd04dc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd4dd12-5115-4816-bfb7-bfcbdd04dc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-589248802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972976c7-c60b-4c9a-87a8-a4bf49c012eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f83f52546141e0b43acc5853ca266f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:24Z,use_quota=True,user_id='306bd9aa81804a22955358e37faf3de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8261e6e2-33dc-4d99-a43c-d3e5a803fffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8261e6e2-33dc-4d99-a43c-d3e5a803fffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c8d8e0-1b77-4e28-931b-a7b2f978ebcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c8d8e0-1b77-4e28-931b-a7b2f978ebcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '972976c7-c60b-4c9a-87a8-a4bf49c012eb', 'volume_name': 'volume-972976c7-c60b-4c9a-87a8-a4bf49c012eb', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d6715e-4fb2-4e94-9994-d3cf6f2de4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d6715e-4fb2-4e94-9994-d3cf6f2de4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb5f595-e157-433f-bfeb-f2b0bd53ce93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:24 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Volume 972976c7-c60b-4c9a-87a8-a4bf49c012eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-972976c7-c60b-4c9a-87a8-a4bf49c012eb', 'volume_size': 1} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d3548918-0a42-4269-8937-aeff769ecb6b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:24 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d3548918-0a42-4269-8937-aeff769ecb6b Jul 06 21:10:24 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Flow 'volume_create_manager' (f710d95b-6d30-410b-8318-909699687d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb5d0fd-28fc-4796-ac41-ae45db503b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb5d0fd-28fc-4796-ac41-ae45db503b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-736779278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4c8593-a229-4bde-9d02-d7bc51a6ac29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f83f52546141e0b43acc5853ca266f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:24Z,use_quota=True,user_id='306bd9aa81804a22955358e37faf3de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b5e62a-ccd6-4e43-ba9f-4ed114bbbcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b5e62a-ccd6-4e43-ba9f-4ed114bbbcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ce5184-82b1-4d58-833b-c30fe156c73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ce5184-82b1-4d58-833b-c30fe156c73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4c8593-a229-4bde-9d02-d7bc51a6ac29', 'volume_name': 'volume-4d4c8593-a229-4bde-9d02-d7bc51a6ac29', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3672d2f-5f52-4800-aa0e-8f3ca8e8e384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3672d2f-5f52-4800-aa0e-8f3ca8e8e384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac5b3d4-c3f9-440e-92fa-7cafddac8ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:24 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Volume 4d4c8593-a229-4bde-9d02-d7bc51a6ac29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4c8593-a229-4bde-9d02-d7bc51a6ac29', 'volume_size': 1} Jul 06 21:10:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:24 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d3548918-0a42-4269-8937-aeff769ecb6b" returned: 0 in 0.934s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] <== create_volume: return (2582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:10:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.585s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.177s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-120818651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e3d15d3-e48f-4547-a455-7f89791ec319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7abc9f6c534e4e5a8670dd9470b80bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:21Z,use_quota=True,user_id='423c401a84094712812df79eeed640fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Creating volume 0e3d15d3-e48f-4547-a455-7f89791ec319 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:25 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:10:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e3d15d3-e48f-4547-a455-7f89791ec319 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1736aa-e948-43c1-bff9-e9ed78fdcde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3548918-0a42-4269-8937-aeff769ecb6b', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84a29ba-ace5-4b2f-b913-baf0321532e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:25 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e3d15d3-e48f-4547-a455-7f89791ec319 1073741824 Jul 06 21:10:25 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:25 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Volume volume-d3548918-0a42-4269-8937-aeff769ecb6b (d3548918-0a42-4269-8937-aeff769ecb6b): created successfully Jul 06 21:10:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84a29ba-ace5-4b2f-b913-baf0321532e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Flow 'volume_create_manager' (afc28a20-4f93-4d81-a143-df7baedc6b9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:25 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-31347cd4-12dd-40dc-bde3-d4f78baa28df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Created volume successfully. Jul 06 21:10:25 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e3d15d3-e48f-4547-a455-7f89791ec319 1073741824" returned: 0 in 0.975s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e3d15d3-e48f-4547-a455-7f89791ec319 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:26 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e3d15d3-e48f-4547-a455-7f89791ec319 Jul 06 21:10:26 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Flow 'volume_create_manager' (96616cda-20a7-45b2-80bd-a1e46fb2c9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5e69544-0f40-40d8-b884-ade866d377a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5e69544-0f40-40d8-b884-ade866d377a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-391522034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a312d5-62f4-4987-9c94-00cd8f0508e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf91a4684da044db85c6285e8ceb955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:26Z,use_quota=True,user_id='193f18baf5d94bb9a2b8367616b42f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe238f6-f639-41a2-8a98-7fd037f4d1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe238f6-f639-41a2-8a98-7fd037f4d1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a247faf9-3133-4b60-82e1-bf4b73d754bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a247faf9-3133-4b60-82e1-bf4b73d754bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2a312d5-62f4-4987-9c94-00cd8f0508e7', 'volume_name': 'volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11916c1e-39fc-432d-b7c1-6ea8d4ba6ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11916c1e-39fc-432d-b7c1-6ea8d4ba6ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f39f854-f9a0-4c3b-871c-7afcd3d00df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:26 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Volume c2a312d5-62f4-4987-9c94-00cd8f0508e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7', 'volume_size': 1} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:26 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e3d15d3-e48f-4547-a455-7f89791ec319" returned: 0 in 0.705s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.290s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1987380869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e094465-b291-422a-ae5f-ade771d7c494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7abc9f6c534e4e5a8670dd9470b80bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:21Z,use_quota=True,user_id='423c401a84094712812df79eeed640fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Creating volume 0e094465-b291-422a-ae5f-ade771d7c494 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:26 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e094465-b291-422a-ae5f-ade771d7c494 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db382cf-f647-420b-b1dc-85ff160a10b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e3d15d3-e48f-4547-a455-7f89791ec319', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:26 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e094465-b291-422a-ae5f-ade771d7c494 1073741824 Jul 06 21:10:26 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170a27d8-97f9-48c5-8c43-0fe36e6ed767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:26 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Volume volume-0e3d15d3-e48f-4547-a455-7f89791ec319 (0e3d15d3-e48f-4547-a455-7f89791ec319): created successfully Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170a27d8-97f9-48c5-8c43-0fe36e6ed767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Flow 'volume_create_manager' (2807d910-a936-4205-84d6-8316187be728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:26 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-4b2c7494-c4e5-47f7-bb1f-29bcd920c053 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Created volume successfully. Jul 06 21:10:27 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e094465-b291-422a-ae5f-ade771d7c494 1073741824" returned: 0 in 0.905s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e094465-b291-422a-ae5f-ade771d7c494 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:27 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e094465-b291-422a-ae5f-ade771d7c494 Jul 06 21:10:27 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:28 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e094465-b291-422a-ae5f-ade771d7c494" returned: 0 in 0.728s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:28 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:10:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.621s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:28 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1281865305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff721718-e0fa-4dbd-a792-dd95ac2c5cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7abc9f6c534e4e5a8670dd9470b80bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:22Z,use_quota=True,user_id='423c401a84094712812df79eeed640fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:28 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Creating volume ff721718-e0fa-4dbd-a792-dd95ac2c5cf8 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:28 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:28 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:28 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:28 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:10:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:28 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f221ad-ca14-4e45-9750-424320d56b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e094465-b291-422a-ae5f-ade771d7c494', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:28 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8 1073741824 Jul 06 21:10:28 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:28 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a14bc7f-2215-4454-95af-0ecee0c6d7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:28 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Volume volume-0e094465-b291-422a-ae5f-ade771d7c494 (0e094465-b291-422a-ae5f-ade771d7c494): created successfully Jul 06 21:10:28 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a14bc7f-2215-4454-95af-0ecee0c6d7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:28 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Flow 'volume_create_manager' (4e69d6b6-c7ff-4023-931f-0e04e26cd86d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:28 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-63056ba6-e1b7-4883-909a-1ba67ef08914 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Created volume successfully. Jul 06 21:10:29 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8 1073741824" returned: 0 in 0.916s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:29 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8 Jul 06 21:10:29 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:30 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8" returned: 0 in 0.712s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.881s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-207390523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240d6b14-8e9c-4b25-9382-2b711c9f5142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f83f52546141e0b43acc5853ca266f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:22Z,use_quota=True,user_id='306bd9aa81804a22955358e37faf3de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Creating volume 240d6b14-8e9c-4b25-9382-2b711c9f5142 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:30 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-240d6b14-8e9c-4b25-9382-2b711c9f5142 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:30 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-240d6b14-8e9c-4b25-9382-2b711c9f5142 1073741824 Jul 06 21:10:30 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de03760-018b-4d03-a66c-97024d25d306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a9cfaf-45dc-48d6-9f6c-6e4d1538802f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:30 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Volume volume-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8 (ff721718-e0fa-4dbd-a792-dd95ac2c5cf8): created successfully Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a9cfaf-45dc-48d6-9f6c-6e4d1538802f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Flow 'volume_create_manager' (75c09dcf-73d2-44f7-b6e6-28abb3841738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:30 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-5b0c49a3-7ea8-4b98-97f9-fbf52e0b026a tempest-CreateVolumesFromSnapshotTest-1533941525 None] Created volume successfully. Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "cinder-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "cinder-quobyte-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-quobyte-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8" acquired by "delete_volume" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b89b26-a08b-46ac-a2c8-cb01bd594a61]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:30 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8 Jul 06 21:10:30 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:31 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-240d6b14-8e9c-4b25-9382-2b711c9f5142 1073741824" returned: 0 in 0.956s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-240d6b14-8e9c-4b25-9382-2b711c9f5142 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:31 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-240d6b14-8e9c-4b25-9382-2b711c9f5142 Jul 06 21:10:31 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:31 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8" returned: 0 in 0.808s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:31 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8 Jul 06 21:10:31 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:31 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-240d6b14-8e9c-4b25-9382-2b711c9f5142" returned: 0 in 0.696s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.843s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1246005686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40de103c-ff87-41de-a5f7-5f6e20864689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f83f52546141e0b43acc5853ca266f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:23Z,use_quota=True,user_id='306bd9aa81804a22955358e37faf3de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Creating volume 40de103c-ff87-41de-a5f7-5f6e20864689 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:31 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40de103c-ff87-41de-a5f7-5f6e20864689 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264257eb-54bd-4975-a891-343c571ae266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240d6b14-8e9c-4b25-9382-2b711c9f5142', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:31 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40de103c-ff87-41de-a5f7-5f6e20864689 1073741824 Jul 06 21:10:31 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf82ca1-ffb0-4193-a675-9aa45b86e262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:31 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Volume volume-240d6b14-8e9c-4b25-9382-2b711c9f5142 (240d6b14-8e9c-4b25-9382-2b711c9f5142): created successfully Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf82ca1-ffb0-4193-a675-9aa45b86e262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Flow 'volume_create_manager' (f01eac06-d2f3-47d2-8fc1-5f7d87ec30be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:31 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-5fc6c0f4-c59b-4e5e-ab56-4135307d4d91 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Created volume successfully. Jul 06 21:10:32 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8" returned: 0 in 0.755s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-quobyte-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8" released by "delete_volume" :: held 1.619s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:32 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] Created reservations ['323150a9-10a5-4192-8a7e-5ec50247c5aa', 'b3b7642f-bcdc-4001-91de-ca9d692524c3', 'd7db595c-cb49-4135-a9fa-4f14820e1ecd', 'ea3a1736-8d5f-47f7-97a5-0c32de28ce94'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:32 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:32 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:32 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:32 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "cinder-0e094465-b291-422a-ae5f-ade771d7c494-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-0e094465-b291-422a-ae5f-ade771d7c494-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:32 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40de103c-ff87-41de-a5f7-5f6e20864689 1073741824" returned: 0 in 1.030s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "cinder-quobyte-0e094465-b291-422a-ae5f-ade771d7c494" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40de103c-ff87-41de-a5f7-5f6e20864689 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:32 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-quobyte-0e094465-b291-422a-ae5f-ade771d7c494" acquired by "delete_volume" :: waited 0.033s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:32 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40de103c-ff87-41de-a5f7-5f6e20864689 Jul 06 21:10:32 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1214fa-2d8c-41a6-b0f2-ba3572909f81]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e094465-b291-422a-ae5f-ade771d7c494 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:33 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e094465-b291-422a-ae5f-ade771d7c494 Jul 06 21:10:33 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:33 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.745s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:33 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] Deleted volume successfully. Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3aa893af-e2a6-418b-9f9f-cdefe5481a1e tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-ff721718-e0fa-4dbd-a792-dd95ac2c5cf8-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:33 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40de103c-ff87-41de-a5f7-5f6e20864689" returned: 0 in 0.773s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.115s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1772706164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9fe136-e0b9-45af-a064-2c5ce55926ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f83f52546141e0b43acc5853ca266f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:23Z,use_quota=True,user_id='306bd9aa81804a22955358e37faf3de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Creating volume df9fe136-e0b9-45af-a064-2c5ce55926ad {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:33 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-df9fe136-e0b9-45af-a064-2c5ce55926ad 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:33 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-df9fe136-e0b9-45af-a064-2c5ce55926ad 1073741824 Jul 06 21:10:33 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b326d9-8995-4d80-8df1-cc6d89dac606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40de103c-ff87-41de-a5f7-5f6e20864689', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90cb0f0-6b53-43cf-a023-9a3c4c37dcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:33 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Volume volume-40de103c-ff87-41de-a5f7-5f6e20864689 (40de103c-ff87-41de-a5f7-5f6e20864689): created successfully Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90cb0f0-6b53-43cf-a023-9a3c4c37dcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Flow 'volume_create_manager' (51613e9d-db6e-4ebd-bf4d-fb2937463031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:33 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0859d0de-35fd-49ba-adca-cafcd7d51e1c tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Created volume successfully. Jul 06 21:10:33 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e094465-b291-422a-ae5f-ade771d7c494" returned: 0 in 0.872s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e094465-b291-422a-ae5f-ade771d7c494 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:33 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e094465-b291-422a-ae5f-ade771d7c494 Jul 06 21:10:33 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:34 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e094465-b291-422a-ae5f-ade771d7c494" returned: 0 in 0.808s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-quobyte-0e094465-b291-422a-ae5f-ade771d7c494" released by "delete_volume" :: held 1.755s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:34 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-df9fe136-e0b9-45af-a064-2c5ce55926ad 1073741824" returned: 0 in 0.996s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-df9fe136-e0b9-45af-a064-2c5ce55926ad {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:34 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-df9fe136-e0b9-45af-a064-2c5ce55926ad Jul 06 21:10:34 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:34 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Created reservations ['63d62e7a-65b5-4767-9293-c6d7c18c39c4', '5061870a-0d8e-47fd-96a9-68558ee825ec', 'dc2ead29-ea1f-4554-9fe8-1f281af182bf', '249a33bf-32ee-4f5b-9bff-1816c6db6ac7'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:34 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:34 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "cinder-0e3d15d3-e48f-4547-a455-7f89791ec319-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-0e3d15d3-e48f-4547-a455-7f89791ec319-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "cinder-quobyte-0e3d15d3-e48f-4547-a455-7f89791ec319" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-quobyte-0e3d15d3-e48f-4547-a455-7f89791ec319" acquired by "delete_volume" :: waited 0.024s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6117f4d8-c2fb-490a-9c6c-2fd182008ef4]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e3d15d3-e48f-4547-a455-7f89791ec319 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:35 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e3d15d3-e48f-4547-a455-7f89791ec319 Jul 06 21:10:35 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:35 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-df9fe136-e0b9-45af-a064-2c5ce55926ad" returned: 0 in 0.776s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.497s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-589248802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972976c7-c60b-4c9a-87a8-a4bf49c012eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f83f52546141e0b43acc5853ca266f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:24Z,use_quota=True,user_id='306bd9aa81804a22955358e37faf3de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Creating volume 972976c7-c60b-4c9a-87a8-a4bf49c012eb {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:35 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-972976c7-c60b-4c9a-87a8-a4bf49c012eb 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:35 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-972976c7-c60b-4c9a-87a8-a4bf49c012eb 1073741824 Jul 06 21:10:35 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924759c4-dbf7-4904-9567-982c3f689007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9fe136-e0b9-45af-a064-2c5ce55926ad', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a6f2fa-1e9d-4557-b8a3-22f75329f998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:UPDATE=166,cinder:SELECT=119,cinder:INSERT=41,cinder:DELETE=19 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:10:35 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Volume volume-df9fe136-e0b9-45af-a064-2c5ce55926ad (df9fe136-e0b9-45af-a064-2c5ce55926ad): created successfully Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a6f2fa-1e9d-4557-b8a3-22f75329f998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Flow 'volume_create_manager' (bc3c83e1-ce17-4def-872a-d8235f707fe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:35 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0f31a5f8-d4d2-42e2-9e5f-b455df257d78 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Created volume successfully. Jul 06 21:10:35 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.906s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:35 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Deleted volume successfully. Jul 06 21:10:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-da2936ea-1604-4da1-93b4-25298ace55df tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-0e094465-b291-422a-ae5f-ade771d7c494-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:36 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e3d15d3-e48f-4547-a455-7f89791ec319" returned: 0 in 0.862s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e3d15d3-e48f-4547-a455-7f89791ec319 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:36 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e3d15d3-e48f-4547-a455-7f89791ec319 Jul 06 21:10:36 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:36 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-972976c7-c60b-4c9a-87a8-a4bf49c012eb 1073741824" returned: 0 in 1.068s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:36 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=124,cinder:UPDATE=151,cinder:INSERT=47,cinder:DELETE=12 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:10:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-972976c7-c60b-4c9a-87a8-a4bf49c012eb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:36 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-972976c7-c60b-4c9a-87a8-a4bf49c012eb Jul 06 21:10:36 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:36 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0e3d15d3-e48f-4547-a455-7f89791ec319" returned: 0 in 0.799s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-quobyte-0e3d15d3-e48f-4547-a455-7f89791ec319" released by "delete_volume" :: held 1.736s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Created reservations ['53cfa076-4555-4521-bb52-49e96d5c994f', '8c8a09a0-fa76-4133-bca4-4d68803b2d65', '62300dea-c623-4d97-9df6-8c3624f0920d', 'a55437d5-1b7b-4693-b823-dd6ac8e2f4a6'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:37 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:37 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "cinder-d3548918-0a42-4269-8937-aeff769ecb6b-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-d3548918-0a42-4269-8937-aeff769ecb6b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:37 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-972976c7-c60b-4c9a-87a8-a4bf49c012eb" returned: 0 in 0.828s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.879s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-736779278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4c8593-a229-4bde-9d02-d7bc51a6ac29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f83f52546141e0b43acc5853ca266f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:24Z,use_quota=True,user_id='306bd9aa81804a22955358e37faf3de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Creating volume 4d4c8593-a229-4bde-9d02-d7bc51a6ac29 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:37 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4d4c8593-a229-4bde-9d02-d7bc51a6ac29 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:37 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4d4c8593-a229-4bde-9d02-d7bc51a6ac29 1073741824 Jul 06 21:10:37 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb5f595-e157-433f-bfeb-f2b0bd53ce93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-972976c7-c60b-4c9a-87a8-a4bf49c012eb', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb621531-695b-4d1e-ace6-38c30243b169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "cinder-quobyte-d3548918-0a42-4269-8937-aeff769ecb6b" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:37 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Volume volume-972976c7-c60b-4c9a-87a8-a4bf49c012eb (972976c7-c60b-4c9a-87a8-a4bf49c012eb): created successfully Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb621531-695b-4d1e-ace6-38c30243b169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Flow 'volume_create_manager' (99f1c35c-c4a7-427e-97e3-246e62b38936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-quobyte-d3548918-0a42-4269-8937-aeff769ecb6b" acquired by "delete_volume" :: waited 0.053s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:37 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-6ffcbd68-b86b-4e32-821f-0aaab9cbda98 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Created volume successfully. Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[585e1de7-8584-4481-b191-4f4c86f37bab]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d3548918-0a42-4269-8937-aeff769ecb6b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:37 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d3548918-0a42-4269-8937-aeff769ecb6b Jul 06 21:10:37 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:37 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.843s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:37 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:37 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Deleted volume successfully. Jul 06 21:10:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f20003cc-eeed-4364-ae40-f18bdec64ad6 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-0e3d15d3-e48f-4547-a455-7f89791ec319-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:38 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4d4c8593-a229-4bde-9d02-d7bc51a6ac29 1073741824" returned: 0 in 0.949s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4d4c8593-a229-4bde-9d02-d7bc51a6ac29 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:38 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4d4c8593-a229-4bde-9d02-d7bc51a6ac29 Jul 06 21:10:38 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:38 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d3548918-0a42-4269-8937-aeff769ecb6b" returned: 0 in 0.942s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d3548918-0a42-4269-8937-aeff769ecb6b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:38 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d3548918-0a42-4269-8937-aeff769ecb6b Jul 06 21:10:38 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:39 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4d4c8593-a229-4bde-9d02-d7bc51a6ac29" returned: 0 in 0.699s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.823s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-391522034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a312d5-62f4-4987-9c94-00cd8f0508e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf91a4684da044db85c6285e8ceb955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:26Z,use_quota=True,user_id='193f18baf5d94bb9a2b8367616b42f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Creating volume c2a312d5-62f4-4987-9c94-00cd8f0508e7 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:39 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:39 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7 1073741824 Jul 06 21:10:39 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac5b3d4-c3f9-440e-92fa-7cafddac8ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4c8593-a229-4bde-9d02-d7bc51a6ac29', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca13d07-c493-42a3-8ac4-44b33ec9afae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:39 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Volume volume-4d4c8593-a229-4bde-9d02-d7bc51a6ac29 (4d4c8593-a229-4bde-9d02-d7bc51a6ac29): created successfully Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca13d07-c493-42a3-8ac4-44b33ec9afae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Flow 'volume_create_manager' (f710d95b-6d30-410b-8318-909699687d13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:39 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-7338bfe5-3a0a-45d7-a469-bd002c42278d tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Created volume successfully. Jul 06 21:10:39 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-d3548918-0a42-4269-8937-aeff769ecb6b" returned: 0 in 0.747s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-quobyte-d3548918-0a42-4269-8937-aeff769ecb6b" released by "delete_volume" :: held 1.763s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Created reservations ['a4cdea5f-0030-41cf-b55c-92c167e52fa1', '35764e9a-99e3-4546-a11c-9adc3654208d', 'ba29496a-48a3-4130-ae10-82371e23083d', '9b840739-33ba-45b1-a765-7cb6b75ccc5e'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:39 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:39 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "cinder-0fff8fb2-88bf-4c16-a74d-aea9c551adff-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "cinder-4d4c8593-a229-4bde-9d02-d7bc51a6ac29-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-4d4c8593-a229-4bde-9d02-d7bc51a6ac29-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-0fff8fb2-88bf-4c16-a74d-aea9c551adff-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "cinder-quobyte-0fff8fb2-88bf-4c16-a74d-aea9c551adff" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "cinder-quobyte-4d4c8593-a229-4bde-9d02-d7bc51a6ac29" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-quobyte-0fff8fb2-88bf-4c16-a74d-aea9c551adff" acquired by "delete_volume" :: waited 0.032s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-quobyte-4d4c8593-a229-4bde-9d02-d7bc51a6ac29" acquired by "delete_volume" :: waited 0.063s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:40 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[883e5020-b732-4aa4-89d5-7d204ad43904]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0fff8fb2-88bf-4c16-a74d-aea9c551adff {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:40 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c67252e-86b5-4ca2-9632-5c1393438583]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4d4c8593-a229-4bde-9d02-d7bc51a6ac29 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:40 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0fff8fb2-88bf-4c16-a74d-aea9c551adff Jul 06 21:10:40 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:40 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4d4c8593-a229-4bde-9d02-d7bc51a6ac29 Jul 06 21:10:40 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:40 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.811s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:40 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:40 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Deleted volume successfully. Jul 06 21:10:40 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-892a191c-7e4f-4513-8ed2-b66609cb1578 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-d3548918-0a42-4269-8937-aeff769ecb6b-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7 1073741824" returned: 0 in 1.219s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:40 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7 Jul 06 21:10:40 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:41 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0fff8fb2-88bf-4c16-a74d-aea9c551adff" returned: 0 in 1.073s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0fff8fb2-88bf-4c16-a74d-aea9c551adff {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:41 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:41 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0fff8fb2-88bf-4c16-a74d-aea9c551adff Jul 06 21:10:41 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4d4c8593-a229-4bde-9d02-d7bc51a6ac29" returned: 0 in 1.098s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4d4c8593-a229-4bde-9d02-d7bc51a6ac29 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:41 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4d4c8593-a229-4bde-9d02-d7bc51a6ac29 Jul 06 21:10:41 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:41 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7" returned: 0 in 0.839s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:41 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] <== create_volume: return (2133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:10:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.136s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f39f854-f9a0-4c3b-871c-7afcd3d00df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96cf8e8c-7163-49ef-a235-40ab9e69d97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:41 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Volume volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7 (c2a312d5-62f4-4987-9c94-00cd8f0508e7): created successfully Jul 06 21:10:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96cf8e8c-7163-49ef-a235-40ab9e69d97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:41 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Flow 'volume_create_manager' (96616cda-20a7-45b2-80bd-a1e46fb2c9d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:41 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-3fbba24a-9a5e-445a-9539-cc9baacaf433 tempest-ProjectMemberTests-464659054 None] Created volume successfully. Jul 06 21:10:42 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-0fff8fb2-88bf-4c16-a74d-aea9c551adff" returned: 0 in 0.889s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-quobyte-0fff8fb2-88bf-4c16-a74d-aea9c551adff" released by "delete_volume" :: held 2.062s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:42 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-4d4c8593-a229-4bde-9d02-d7bc51a6ac29" returned: 0 in 0.884s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-quobyte-4d4c8593-a229-4bde-9d02-d7bc51a6ac29" released by "delete_volume" :: held 2.061s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:42 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] Created reservations ['d8915415-9928-460f-8a52-37a0551864f9', '0a0497f8-39ae-4c1c-9671-e1e18c4563a2', '3f552cc4-f4bb-4533-b5c7-9f35d0171ab7', '1754f616-d93b-4e48-af6d-768c578d09f6'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:42 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Created reservations ['83e5757a-3ee3-4ead-882d-bf1683d5458b', '0aa3f895-7e01-4b85-922f-eff01fb4e1ba', '6414650f-10a3-4d21-8d60-1e87d5ca6cc0', '2209ece5-70b8-4752-9eed-38e3a075e725'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:42 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:42 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:42 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:42 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] Creating offline snapshot 9ed84c8b-f1f7-47a5-832b-f55c87e4f704 of volume c2a312d5-62f4-4987-9c94-00cd8f0508e7 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "cinder-1b21faeb-a081-4f1b-946e-74f2bf8af14d-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42476f7-00e6-47fe-9a07-51c42891c080]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-1b21faeb-a081-4f1b-946e-74f2bf8af14d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "cinder-quobyte-281ee0de-35b2-4299-a5ff-e96cd24aa740" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "cinder-972976c7-c60b-4c9a-87a8-a4bf49c012eb-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-quobyte-281ee0de-35b2-4299-a5ff-e96cd24aa740" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "cinder-quobyte-1b21faeb-a081-4f1b-946e-74f2bf8af14d" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:43 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:43 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-972976c7-c60b-4c9a-87a8-a4bf49c012eb-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.054s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.149s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-quobyte-1b21faeb-a081-4f1b-946e-74f2bf8af14d" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Deleting offline snapshot 1b21faeb-a081-4f1b-946e-74f2bf8af14d of volume 281ee0de-35b2-4299-a5ff-e96cd24aa740 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] snapshot_file for this snap is: volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:10:43 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Deleted volume successfully. Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ece3d3a-5a5e-4d62-91d2-222595c09a31]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:43 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7 Jul 06 21:10:43 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-336c4d65-701d-4841-ae3b-778fd8922746 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-4d4c8593-a229-4bde-9d02-d7bc51a6ac29-delete_volume" released by "delete_volume" :: held 3.696s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:43 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] Deleted volume successfully. Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "cinder-quobyte-972976c7-c60b-4c9a-87a8-a4bf49c012eb" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-1caae6bf-286d-4911-ae5c-69e23a1ac9ba tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-0fff8fb2-88bf-4c16-a74d-aea9c551adff-delete_volume" released by "delete_volume" :: held 3.705s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-quobyte-972976c7-c60b-4c9a-87a8-a4bf49c012eb" acquired by "delete_volume" :: waited 0.034s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:43 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[acebb064-dfee-4391-a73e-7e1e761a4f7f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-972976c7-c60b-4c9a-87a8-a4bf49c012eb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:43 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:43 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-972976c7-c60b-4c9a-87a8-a4bf49c012eb Jul 06 21:10:43 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:44 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:44 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7" returned: 0 in 1.150s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d" returned: 0 in 0.946s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-281ee0de-35b2-4299-a5ff-e96cd24aa740(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:10:44 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704 1G Jul 06 21:10:44 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:44 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16870a3-3af8-4c80-8aa8-2d5f8a73ee03]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:44 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740 Jul 06 21:10:44 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:44 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-972976c7-c60b-4c9a-87a8-a4bf49c012eb" returned: 0 in 1.055s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-972976c7-c60b-4c9a-87a8-a4bf49c012eb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:44 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-972976c7-c60b-4c9a-87a8-a4bf49c012eb Jul 06 21:10:44 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:45 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704 1G" returned: 0 in 1.033s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:45 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-972976c7-c60b-4c9a-87a8-a4bf49c012eb" returned: 0 in 0.769s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-quobyte-972976c7-c60b-4c9a-87a8-a4bf49c012eb" released by "delete_volume" :: held 1.896s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:45 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704 Jul 06 21:10:45 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:45 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740" returned: 0 in 1.030s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:45 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d Jul 06 21:10:45 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:45 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Created reservations ['35abe9ba-3e9c-4193-90e8-47938abe89db', 'b25b55d8-95da-4756-be78-05357dda0b44', '3338bb49-f29a-4396-99d4-aa357c198ccb', 'beae1d69-ac3d-4b15-b3d6-5a354ec9fc5f'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:45 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:45 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:46 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704" returned: 0 in 0.826s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:46 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704 is being set with open permissions: ugo+rw Jul 06 21:10:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:46 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704 Jul 06 21:10:46 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:46 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d" returned: 0 in 0.933s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:46 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:46 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d Jul 06 21:10:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.824s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:46 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:46 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:46 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Deleted volume successfully. Jul 06 21:10:46 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-493d2163-642d-420e-97ca-d712b99a2e02 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-972976c7-c60b-4c9a-87a8-a4bf49c012eb-delete_volume" released by "delete_volume" :: held 3.144s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:46 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "cinder-df9fe136-e0b9-45af-a064-2c5ce55926ad-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:46 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-df9fe136-e0b9-45af-a064-2c5ce55926ad-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:46 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "cinder-quobyte-df9fe136-e0b9-45af-a064-2c5ce55926ad" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:47 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-quobyte-df9fe136-e0b9-45af-a064-2c5ce55926ad" acquired by "delete_volume" :: waited 0.024s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:47 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb57bc1-ae5f-4248-ae40-778275eb3a08]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-df9fe136-e0b9-45af-a064-2c5ce55926ad {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:47 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-df9fe136-e0b9-45af-a064-2c5ce55926ad Jul 06 21:10:47 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:47 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704" returned: 0 in 0.916s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:47 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.info Jul 06 21:10:47 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:47 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740.1b21faeb-a081-4f1b-946e-74f2bf8af14d" returned: 0 in 0.909s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:47 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-quobyte-1b21faeb-a081-4f1b-946e-74f2bf8af14d" released by "_delete_snapshot" :: held 4.012s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:47 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-quobyte-281ee0de-35b2-4299-a5ff-e96cd24aa740" released by "delete_snapshot" :: held 4.080s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:47 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Created reservations ['7b73027c-8e2b-4e36-b328-c7569bc4eb0a', 'e8211277-04fe-4508-8a3d-41e6d99d50aa', 'daf3efc2-78cb-4563-af4e-1dc46a9542e1', 'd1943d11-655a-4d76-a28d-b64f1d505fde'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:47 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Delete snapshot completed successfully. Jul 06 21:10:47 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0d003c1a-506d-4679-bd6e-9d165c60b6a7 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-1b21faeb-a081-4f1b-946e-74f2bf8af14d-delete_snapshot" released by "delete_snapshot" :: held 4.331s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:48 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-df9fe136-e0b9-45af-a064-2c5ce55926ad" returned: 0 in 1.031s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-df9fe136-e0b9-45af-a064-2c5ce55926ad {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:48 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-df9fe136-e0b9-45af-a064-2c5ce55926ad Jul 06 21:10:48 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:48 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.info" returned: 0 in 0.908s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:48 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.info is being set with open permissions: ugo+rw Jul 06 21:10:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:48 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.info Jul 06 21:10:48 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "cinder-281ee0de-35b2-4299-a5ff-e96cd24aa740-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-281ee0de-35b2-4299-a5ff-e96cd24aa740-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "cinder-quobyte-281ee0de-35b2-4299-a5ff-e96cd24aa740" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-quobyte-281ee0de-35b2-4299-a5ff-e96cd24aa740" acquired by "delete_volume" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:48 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-df9fe136-e0b9-45af-a064-2c5ce55926ad" returned: 0 in 0.831s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-quobyte-df9fe136-e0b9-45af-a064-2c5ce55926ad" released by "delete_volume" :: held 1.926s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:48 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ed4ce3-773e-4819-b8cf-bed618d644c2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Created reservations ['08f094f7-ddb3-4606-a5b3-d9c6e96d52f2', '53cdacb2-d246-4149-84dd-87e2cf34fe98', '95004e59-cb2c-4d22-bb4b-4584f8e7ab7b', '88f344b6-93d1-42a1-babe-087fbd137661'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:49 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740 Jul 06 21:10:49 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:49 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:49 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:49 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.info" returned: 0 in 0.926s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.969s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "cinder-40de103c-ff87-41de-a5f7-5f6e20864689-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-40de103c-ff87-41de-a5f7-5f6e20864689-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:49 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e0887a9b-72b1-4af9-a0c7-57422b7496b0 tempest-ProjectMemberTests-464659054 None] Create snapshot completed successfully Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "cinder-quobyte-40de103c-ff87-41de-a5f7-5f6e20864689" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-quobyte-40de103c-ff87-41de-a5f7-5f6e20864689" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97ea681-1e69-46bf-9cf3-3ba4fc2d7fff]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40de103c-ff87-41de-a5f7-5f6e20864689 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:49 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40de103c-ff87-41de-a5f7-5f6e20864689 Jul 06 21:10:49 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-9ed84c8b-f1f7-47a5-832b-f55c87e4f704-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] Lock "cinder-9ed84c8b-f1f7-47a5-832b-f55c87e4f704-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-c2a312d5-62f4-4987-9c94-00cd8f0508e7" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-c2a312d5-62f4-4987-9c94-00cd8f0508e7" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-9ed84c8b-f1f7-47a5-832b-f55c87e4f704" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-9ed84c8b-f1f7-47a5-832b-f55c87e4f704" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] Deleting offline snapshot 9ed84c8b-f1f7-47a5-832b-f55c87e4f704 of volume c2a312d5-62f4-4987-9c94-00cd8f0508e7 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] snapshot_file for this snap is: volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fa2f77-a305-4c0c-ba2b-1e7b23b7fdee]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:50 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704 Jul 06 21:10:50 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:50 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.971s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:50 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:50 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:50 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Deleted volume successfully. Jul 06 21:10:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740" returned: 0 in 1.218s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:50 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740 Jul 06 21:10:50 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b537318a-30ca-4d87-89fd-7f0b68274564 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-df9fe136-e0b9-45af-a064-2c5ce55926ad-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:50 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40de103c-ff87-41de-a5f7-5f6e20864689" returned: 0 in 1.289s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40de103c-ff87-41de-a5f7-5f6e20864689 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:50 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40de103c-ff87-41de-a5f7-5f6e20864689 Jul 06 21:10:50 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:50 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-281ee0de-35b2-4299-a5ff-e96cd24aa740" returned: 0 in 0.774s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-quobyte-281ee0de-35b2-4299-a5ff-e96cd24aa740" released by "delete_volume" :: held 2.085s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Created reservations ['46f31f75-4a5c-4fb3-891a-faf9ccb551e1', 'ead6968e-695e-4960-bd1c-968625f90277', '4f0a0fc6-1466-4b86-befc-124666977f9d', '421b5f71-368c-4aab-9d48-9f0e677bd4b2'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:51 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704" returned: 0 in 1.285s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c290c59-967a-4543-a0ae-7f93a36de6ae]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:51 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:51 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:51 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7 Jul 06 21:10:51 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:51 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-40de103c-ff87-41de-a5f7-5f6e20864689" returned: 0 in 0.997s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-quobyte-40de103c-ff87-41de-a5f7-5f6e20864689" released by "delete_volume" :: held 2.338s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Created reservations ['7828f392-af13-4f4e-a5fc-41a70a50f52f', 'c76536c4-3570-4805-af56-bca33f8ad3ba', '0c45f47c-89aa-4fab-aad9-a8b9cc7ef748', '318f8e05-0adc-4679-9691-1479e65b8e18'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:51 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:51 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:52 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.937s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:52 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:52 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7" returned: 0 in 0.984s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:52 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Deleted volume successfully. Jul 06 21:10:52 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704 Jul 06 21:10:52 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dfea569f-7f3b-4adb-8e60-ea742caf6e08 tempest-CreateVolumesFromSnapshotTest-1533941525 None] Lock "cinder-281ee0de-35b2-4299-a5ff-e96cd24aa740-delete_volume" released by "delete_volume" :: held 3.406s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "cinder-240d6b14-8e9c-4b25-9382-2b711c9f5142-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-240d6b14-8e9c-4b25-9382-2b711c9f5142-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "cinder-quobyte-240d6b14-8e9c-4b25-9382-2b711c9f5142" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-quobyte-240d6b14-8e9c-4b25-9382-2b711c9f5142" acquired by "delete_volume" :: waited 0.025s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:52 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87e12ee-6953-4800-be6b-5cbc23f32a58]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-240d6b14-8e9c-4b25-9382-2b711c9f5142 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:52 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.056s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:53 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:53 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Deleted volume successfully. Jul 06 21:10:53 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-240d6b14-8e9c-4b25-9382-2b711c9f5142 Jul 06 21:10:53 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c543b784-d509-4456-85f8-a7c8158df69f tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-40de103c-ff87-41de-a5f7-5f6e20864689-delete_volume" released by "delete_volume" :: held 3.730s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:53 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:53 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704" returned: 0 in 0.965s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:53 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704 Jul 06 21:10:53 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:53 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-240d6b14-8e9c-4b25-9382-2b711c9f5142" returned: 0 in 0.965s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-240d6b14-8e9c-4b25-9382-2b711c9f5142 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:53 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-240d6b14-8e9c-4b25-9382-2b711c9f5142 Jul 06 21:10:53 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:54 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7.9ed84c8b-f1f7-47a5-832b-f55c87e4f704" returned: 0 in 0.930s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-9ed84c8b-f1f7-47a5-832b-f55c87e4f704" released by "_delete_snapshot" :: held 4.315s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-c2a312d5-62f4-4987-9c94-00cd8f0508e7" released by "delete_snapshot" :: held 4.368s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:54 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] Created reservations ['1b07780b-c5cc-4557-82b7-2416d3153428', 'ae508ab5-ddf3-44f5-8000-c0738ac2e60f', '5af75391-61b9-41af-8fbf-acea60316a13', '4b682589-5722-418a-a55f-2855631b78fd'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:54 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] Delete snapshot completed successfully. Jul 06 21:10:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-5281d2ff-ef47-437c-9033-b900039d65ea tempest-ProjectMemberTests-464659054 None] Lock "cinder-9ed84c8b-f1f7-47a5-832b-f55c87e4f704-delete_snapshot" released by "delete_snapshot" :: held 4.592s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:54 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-240d6b14-8e9c-4b25-9382-2b711c9f5142" returned: 0 in 0.809s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-quobyte-240d6b14-8e9c-4b25-9382-2b711c9f5142" released by "delete_volume" :: held 1.842s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:54 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Created reservations ['95656daa-294c-4252-a381-03feb70726d2', '7f7b418e-9a5a-43cc-8881-1605e76b2069', '3cce0cc0-0ea5-4572-a0bc-9491c560c612', 'b00ec2ec-e422-4c2b-842c-e3258d8e5cca'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:54 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:54 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "cinder-7583327e-5d8a-40da-a197-ea8c94ec8513-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-7583327e-5d8a-40da-a197-ea8c94ec8513-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-c2a312d5-62f4-4987-9c94-00cd8f0508e7-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] Lock "cinder-c2a312d5-62f4-4987-9c94-00cd8f0508e7-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "cinder-quobyte-7583327e-5d8a-40da-a197-ea8c94ec8513" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-quobyte-7583327e-5d8a-40da-a197-ea8c94ec8513" acquired by "delete_volume" :: waited 0.026s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:55 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[480b2c9d-7b80-469a-9dc9-1b2a7da29340]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7583327e-5d8a-40da-a197-ea8c94ec8513 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-c2a312d5-62f4-4987-9c94-00cd8f0508e7" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-c2a312d5-62f4-4987-9c94-00cd8f0508e7" acquired by "delete_volume" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:55 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc033bd-35ed-4934-9a98-1ac8b57d1822]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:55 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7583327e-5d8a-40da-a197-ea8c94ec8513 Jul 06 21:10:55 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:55 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7 Jul 06 21:10:55 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:55 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.972s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:55 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:55 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Deleted volume successfully. Jul 06 21:10:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7545d30c-4b33-4961-aafa-c9c5d3024877 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-240d6b14-8e9c-4b25-9382-2b711c9f5142-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Flow 'volume_create_manager' (590af815-1ed3-43d6-bd46-0d0d416959a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd221613-e80e-4bfb-8985-d82c584433e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd221613-e80e-4bfb-8985-d82c584433e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-934074276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05984c2-00fb-4901-be22-4ed0bb6c17b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='220177e50cf04c83b27b175326b3dc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:56Z,use_quota=True,user_id='b4a14ee51dc347d8b4c72112b2e9b2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b69d99e-f3ee-4dd6-a3c1-8dfbfc13b940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b69d99e-f3ee-4dd6-a3c1-8dfbfc13b940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb98c84-bc32-4b37-89d2-89a4df2b7de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb98c84-bc32-4b37-89d2-89a4df2b7de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f05984c2-00fb-4901-be22-4ed0bb6c17b0', 'volume_name': 'volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea20419-2977-4463-8b42-eb3302b8e228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea20419-2977-4463-8b42-eb3302b8e228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9993247-6940-4f07-bcfb-1ed235f38eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:56 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Volume f05984c2-00fb-4901-be22-4ed0bb6c17b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0', 'volume_size': 1} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-934074276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05984c2-00fb-4901-be22-4ed0bb6c17b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='220177e50cf04c83b27b175326b3dc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:56Z,use_quota=True,user_id='b4a14ee51dc347d8b4c72112b2e9b2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Creating volume f05984c2-00fb-4901-be22-4ed0bb6c17b0 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:56 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:56 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7" returned: 0 in 0.991s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:56 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 1073741824 Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:56 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:56 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7 Jul 06 21:10:56 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:56 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7583327e-5d8a-40da-a197-ea8c94ec8513" returned: 0 in 1.203s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7583327e-5d8a-40da-a197-ea8c94ec8513 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:56 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7583327e-5d8a-40da-a197-ea8c94ec8513 Jul 06 21:10:56 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:57 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7583327e-5d8a-40da-a197-ea8c94ec8513" returned: 0 in 0.797s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-quobyte-7583327e-5d8a-40da-a197-ea8c94ec8513" released by "delete_volume" :: held 2.083s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:57 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Created reservations ['8a4201a0-130f-4b90-a90c-d068bad9705f', '44d91a6b-6c99-462b-87d3-d02c3007e661', 'e1fb415e-a004-4670-859c-76708443c886', '45ac645b-5f8a-4ab9-b937-0ee5d9db7598'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c2a312d5-62f4-4987-9c94-00cd8f0508e7" returned: 0 in 1.052s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-c2a312d5-62f4-4987-9c94-00cd8f0508e7" released by "delete_volume" :: held 2.163s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:57 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:57 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] Created reservations ['227ac161-39bf-4304-b290-dc0f8fb24dc9', 'a3ff9a9a-dd8a-4e2a-9b26-852f2dc153ab', 'c03d7d44-0765-4a91-876c-3455c57a7a26', 'b15fa011-2511-492f-a087-ea4c3694971f'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:57 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 1073741824" returned: 0 in 1.431s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:57 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:57 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:57 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 Jul 06 21:10:57 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:10:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:58 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:10:58 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:58 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.039s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:58 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] Deleted volume successfully. Jul 06 21:10:58 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:58 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e46362c0-1cf0-4324-b0fe-587eff2c6e7f tempest-ProjectMemberTests-464659054 None] Lock "cinder-c2a312d5-62f4-4987-9c94-00cd8f0508e7-delete_volume" released by "delete_volume" :: held 3.688s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.302s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:58 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Deleted volume successfully. Jul 06 21:10:58 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-72890108-c6d7-4d19-bd59-959dff3ef275 tempest-CreateVolumesFromSourceVolumeTest-426569773 None] Lock "cinder-7583327e-5d8a-40da-a197-ea8c94ec8513-delete_volume" released by "delete_volume" :: held 3.831s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0" returned: 0 in 1.120s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] <== create_volume: return (2633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.636s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9993247-6940-4f07-bcfb-1ed235f38eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b3140f-c8d9-4726-96b8-7163ca71f940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:59 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Volume volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 (f05984c2-00fb-4901-be22-4ed0bb6c17b0): created successfully Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b3140f-c8d9-4726-96b8-7163ca71f940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Flow 'volume_create_manager' (590af815-1ed3-43d6-bd46-0d0d416959a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:59 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f42d2b60-52c7-47fc-a8b0-483ca878d2b9 tempest-VolumeDependencyTests-2062767927 None] Created volume successfully. Jul 06 21:10:59 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.217s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 29 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Flow 'volume_create_manager' (4d6c79fa-6f0d-4f17-8ad3-fe74fcdf0038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1bfeae1-3e2c-4c72-881a-57318ce5f937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1bfeae1-3e2c-4c72-881a-57318ce5f937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-837389103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7951c251-61b6-460d-9509-e5dcb3c6f0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf91a4684da044db85c6285e8ceb955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:00Z,use_quota=True,user_id='193f18baf5d94bb9a2b8367616b42f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6921e15-4e7b-487b-b9b0-783480cea35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6921e15-4e7b-487b-b9b0-783480cea35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd09fff9-9924-4051-b115-5f2181cdad4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd09fff9-9924-4051-b115-5f2181cdad4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7951c251-61b6-460d-9509-e5dcb3c6f0bb', 'volume_name': 'volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70c4168-f8c7-4ef1-be98-87132eecb93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70c4168-f8c7-4ef1-be98-87132eecb93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69caa1e-51c4-443f-ba97-0b70b68f91c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:59 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Volume 7951c251-61b6-460d-9509-e5dcb3c6f0bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb', 'volume_size': 1} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-837389103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7951c251-61b6-460d-9509-e5dcb3c6f0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf91a4684da044db85c6285e8ceb955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:00Z,use_quota=True,user_id='193f18baf5d94bb9a2b8367616b42f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Creating volume 7951c251-61b6-460d-9509-e5dcb3c6f0bb {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:59 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:59 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb 1073741824 Jul 06 21:10:59 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:01 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb 1073741824" returned: 0 in 1.102s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:01 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb Jul 06 21:11:01 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:01 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb" returned: 0 in 0.693s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:11:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.810s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69caa1e-51c4-443f-ba97-0b70b68f91c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f956210b-754e-4028-8d71-e55f2ad126eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] Creating offline snapshot 92d035c9-68ec-4d2f-908c-f2bc36ea620d of volume f05984c2-00fb-4901-be22-4ed0bb6c17b0 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:11:01 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Volume volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb (7951c251-61b6-460d-9509-e5dcb3c6f0bb): created successfully Jul 06 21:11:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f956210b-754e-4028-8d71-e55f2ad126eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:01 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Flow 'volume_create_manager' (4d6c79fa-6f0d-4f17-8ad3-fe74fcdf0038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:01 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17ac32f-a759-4538-a678-33d8d31cd341]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:01 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e8da9c6e-0a66-4c22-9fd0-f15d3575b607 tempest-ProjectMemberTests-464659054 None] Created volume successfully. Jul 06 21:11:01 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 Jul 06 21:11:01 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:02 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0" returned: 0 in 0.948s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:02 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d 1G Jul 06 21:11:02 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:03 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:11:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Flow 'volume_create_manager' (f14d6b9a-99e5-4a56-9df8-89a4acdce63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541e5786-0334-47bd-8c48-f593e8431fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541e5786-0334-47bd-8c48-f593e8431fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1341863824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f24c983-db97-4d5b-ba2c-b1677a7719e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80690609554a4d963b933edd407180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:03Z,use_quota=True,user_id='bbe26faf12eb47158f31b0e3462ca501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5ff954-1420-4a6d-a4ed-470a92870183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5ff954-1420-4a6d-a4ed-470a92870183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f3339b-7101-4943-8c83-4f8277801951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f3339b-7101-4943-8c83-4f8277801951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f24c983-db97-4d5b-ba2c-b1677a7719e9', 'volume_name': 'volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e9a785-f20b-4ce6-a3de-c24cd2796d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e9a785-f20b-4ce6-a3de-c24cd2796d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07d82cc-02f8-44e9-bfd8-b861968476f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:03 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Volume 2f24c983-db97-4d5b-ba2c-b1677a7719e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9', 'volume_size': 1} Jul 06 21:11:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:03 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d 1G" returned: 0 in 0.853s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:03 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d Jul 06 21:11:03 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:04 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d" returned: 0 in 0.650s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:04 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d is being set with open permissions: ugo+rw Jul 06 21:11:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:04 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d Jul 06 21:11:04 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:04 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d" returned: 0 in 0.615s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:04 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.info Jul 06 21:11:04 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:05 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.info" returned: 0 in 0.637s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:05 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.info is being set with open permissions: ugo+rw Jul 06 21:11:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:05 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.info Jul 06 21:11:05 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:06 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.info" returned: 0 in 0.605s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.428s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.187s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] Creating offline snapshot 68f25958-d77d-462b-966c-0ab8e99936e3 of volume 7951c251-61b6-460d-9509-e5dcb3c6f0bb {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:11:06 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-773e5bf1-7d08-4b1f-8271-e4e050460690 tempest-VolumeDependencyTests-2062767927 None] Create snapshot completed successfully Jul 06 21:11:06 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e1db29-ec96-4fb6-b65c-e4449bcb3765]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:06 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb Jul 06 21:11:06 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:06 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb" returned: 0 in 0.738s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:07 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3 1G Jul 06 21:11:07 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:07 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:11:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Flow 'volume_create_manager' (d4deedad-4390-4092-9c50-313ae26e2d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b27962d-be7e-4118-a62a-ce760b7139fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b27962d-be7e-4118-a62a-ce760b7139fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1991950472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7019980d-315d-4ba2-99f9-ea06dd9198d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='220177e50cf04c83b27b175326b3dc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=92d035c9-68ec-4d2f-908c-f2bc36ea620d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:08Z,use_quota=True,user_id='b4a14ee51dc347d8b4c72112b2e9b2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25a72cf-8123-4103-869e-9710442a3b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25a72cf-8123-4103-869e-9710442a3b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51585e64-fc3b-466c-8a13-d4fa7b148a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51585e64-fc3b-466c-8a13-d4fa7b148a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7019980d-315d-4ba2-99f9-ea06dd9198d2', 'volume_name': 'volume-7019980d-315d-4ba2-99f9-ea06dd9198d2', 'volume_size': 1, 'snapshot_id': '92d035c9-68ec-4d2f-908c-f2bc36ea620d'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c570a246-5c99-44f5-8599-e24a4dbfaa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c570a246-5c99-44f5-8599-e24a4dbfaa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:07 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee77aff2-be35-486b-b0a1-99a1b9f9f3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:07 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Volume 7019980d-315d-4ba2-99f9-ea06dd9198d2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7019980d-315d-4ba2-99f9-ea06dd9198d2', 'volume_size': 1, 'snapshot_id': '92d035c9-68ec-4d2f-908c-f2bc36ea620d'} Jul 06 21:11:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:07 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3 1G" returned: 0 in 0.909s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:07 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3 Jul 06 21:11:07 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:08 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3" returned: 0 in 0.669s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:08 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3 is being set with open permissions: ugo+rw Jul 06 21:11:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:08 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3 Jul 06 21:11:08 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:09 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3" returned: 0 in 0.620s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:09 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.info Jul 06 21:11:09 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:09 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.info" returned: 0 in 0.626s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:09 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.info is being set with open permissions: ugo+rw Jul 06 21:11:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:09 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.info Jul 06 21:11:09 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:10 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.info" returned: 0 in 0.615s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.263s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.884s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1341863824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f24c983-db97-4d5b-ba2c-b1677a7719e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80690609554a4d963b933edd407180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:03Z,use_quota=True,user_id='bbe26faf12eb47158f31b0e3462ca501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:11:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Creating volume 2f24c983-db97-4d5b-ba2c-b1677a7719e9 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:11:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:11:10 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:11:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:10 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 1073741824 Jul 06 21:11:10 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:10 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-085bd07e-bb4c-4270-a2ff-740bf05cab0d tempest-ProjectMemberTests-464659054 None] Create snapshot completed successfully Jul 06 21:11:11 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 1073741824" returned: 0 in 0.770s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:11 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 Jul 06 21:11:11 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-68f25958-d77d-462b-966c-0ab8e99936e3-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] Lock "cinder-68f25958-d77d-462b-966c-0ab8e99936e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-7951c251-61b6-460d-9509-e5dcb3c6f0bb" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-7951c251-61b6-460d-9509-e5dcb3c6f0bb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-68f25958-d77d-462b-966c-0ab8e99936e3" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-68f25958-d77d-462b-966c-0ab8e99936e3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] Deleting offline snapshot 68f25958-d77d-462b-966c-0ab8e99936e3 of volume 7951c251-61b6-460d-9509-e5dcb3c6f0bb {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] snapshot_file for this snap is: volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2016b1-5d66-4bd4-b1bf-4ae094043291]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:11 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3 Jul 06 21:11:11 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:11 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9" returned: 0 in 0.647s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.090s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Acquiring lock "cinder-quobyte-92d035c9-68ec-4d2f-908c-f2bc36ea620d-7019980d-315d-4ba2-99f9-ea06dd9198d2" by "_create_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07d82cc-02f8-44e9-bfd8-b861968476f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb6fac02-006c-4165-b2e5-69f1f8427d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Lock "cinder-quobyte-92d035c9-68ec-4d2f-908c-f2bc36ea620d-7019980d-315d-4ba2-99f9-ea06dd9198d2" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Creating volume 7019980d-315d-4ba2-99f9-ea06dd9198d2 from snapshot 92d035c9-68ec-4d2f-908c-f2bc36ea620d {{(pid=87207) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Acquiring lock "cinder-quobyte-7019980d-315d-4ba2-99f9-ea06dd9198d2" by "_copy_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:11 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Volume volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 (2f24c983-db97-4d5b-ba2c-b1677a7719e9): created successfully Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb6fac02-006c-4165-b2e5-69f1f8427d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:11 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Flow 'volume_create_manager' (f14d6b9a-99e5-4a56-9df8-89a4acdce63a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Lock "cinder-quobyte-7019980d-315d-4ba2-99f9-ea06dd9198d2" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] snapshot: 92d035c9-68ec-4d2f-908c-f2bc36ea620d, volume: 7019980d-315d-4ba2-99f9-ea06dd9198d2, {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 21:11:12 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-963feeac-e1a0-42d1-b7c6-97211c57d6d8 tempest-SnapshotDependencyTests-220526978 None] Created volume successfully. Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf36ab7-9864-4164-8d04-5701a1c92b47]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:12 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d Jul 06 21:11:12 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:12 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3" returned: 0 in 0.765s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[834212af-c579-4a3a-9eac-4114b0b7fc7d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:12 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb Jul 06 21:11:12 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:12 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d" returned: 0 in 0.766s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Creating direct copy from snapshot {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2075aca5-94c1-4050-a850-18a87cc3e565]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:12 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 Jul 06 21:11:12 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:12 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb" returned: 0 in 0.777s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:13 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3 Jul 06 21:11:13 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:13 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0" returned: 0 in 0.831s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:13 devstack cinder-volume[87207]: DEBUG cinder.utils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Path /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7019980d-315d-4ba2-99f9-ea06dd9198d2 not found in is_blk_device check {{(pid=87207) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 21:11:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7019980d-315d-4ba2-99f9-ea06dd9198d2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:13 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7019980d-315d-4ba2-99f9-ea06dd9198d2 Jul 06 21:11:13 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:13 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3" returned: 0 in 0.733s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:13 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3 Jul 06 21:11:13 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:14 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb.68f25958-d77d-462b-966c-0ab8e99936e3" returned: 0 in 0.629s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-68f25958-d77d-462b-966c-0ab8e99936e3" released by "_delete_snapshot" :: held 3.013s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-7951c251-61b6-460d-9509-e5dcb3c6f0bb" released by "delete_snapshot" :: held 3.041s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:14 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] Created reservations ['e3e60480-1ad5-4d7e-89e5-597d4ffcc123', 'f1696ba1-7bd7-46a8-9489-deb73279c2ee', 'ace851a0-cf76-43a0-820e-bb1f28c3aeee', 'b7767dac-188b-4220-8dce-c9656e6947e0'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:11:14 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] Delete snapshot completed successfully. Jul 06 21:11:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bbdc06e0-5014-473f-83e9-8d7af24854fb tempest-ProjectMemberTests-464659054 None] Lock "cinder-68f25958-d77d-462b-966c-0ab8e99936e3-delete_snapshot" released by "delete_snapshot" :: held 3.311s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-7951c251-61b6-460d-9509-e5dcb3c6f0bb-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] Lock "cinder-7951c251-61b6-460d-9509-e5dcb3c6f0bb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-7951c251-61b6-460d-9509-e5dcb3c6f0bb" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:15 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-7951c251-61b6-460d-9509-e5dcb3c6f0bb" acquired by "delete_volume" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:15 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aba9faa-784a-47a5-b4db-301ee84342f3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:16 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb Jul 06 21:11:16 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:17 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb" returned: 0 in 1.190s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:17 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb Jul 06 21:11:17 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:18 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7951c251-61b6-460d-9509-e5dcb3c6f0bb" returned: 0 in 1.357s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:18 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-7951c251-61b6-460d-9509-e5dcb3c6f0bb" released by "delete_volume" :: held 2.665s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:18 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7019980d-315d-4ba2-99f9-ea06dd9198d2" returned: 0 in 4.888s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:18 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[021e14fb-6fec-4fcc-ae5d-53c7d5604531]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:18 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] Created reservations ['1c2a475a-54d6-48a7-8292-0895d8b38843', '9f3b7b01-f456-4e76-b636-31fa85b54435', 'f4f69fc8-611c-42e0-9ae0-8a0344d3961d', 'cfd1080a-08f7-4d81-b6e4-77130f8e261c'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:11:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:18 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 Jul 06 21:11:18 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:18 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:11:18 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:19 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.660s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:19 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:11:19 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] Deleted volume successfully. Jul 06 21:11:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cc3f7199-9b3a-4799-ba26-8868943f8590 tempest-ProjectMemberTests-464659054 None] Lock "cinder-7951c251-61b6-460d-9509-e5dcb3c6f0bb-delete_volume" released by "delete_volume" :: held 3.613s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:19 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0" returned: 0 in 0.907s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:19 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Image conversion details: src /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0, size 1024.00 MB, duration 4.89 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7019980d-315d-4ba2-99f9-ea06dd9198d2 {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:11:19 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Converted 1024.00 MB image at 209.44 MB/s Jul 06 21:11:19 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7019980d-315d-4ba2-99f9-ea06dd9198d2 is being set with open permissions: ugo+rw Jul 06 21:11:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7019980d-315d-4ba2-99f9-ea06dd9198d2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:19 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7019980d-315d-4ba2-99f9-ea06dd9198d2 Jul 06 21:11:19 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:19 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:11:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Flow 'volume_create_manager' (17427fef-1c98-40ce-aac8-858019f3720d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2dabbf-3929-41ae-ae4d-7ccbf86c55d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2dabbf-3929-41ae-ae4d-7ccbf86c55d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-106591342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fcbc8f-afe7-40e4-b6d4-08deef2414e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf91a4684da044db85c6285e8ceb955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:20Z,use_quota=True,user_id='193f18baf5d94bb9a2b8367616b42f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bbf841c-0ddc-45c5-a3d6-f74a03ab1631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bbf841c-0ddc-45c5-a3d6-f74a03ab1631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9cb1c76-d416-4a83-802e-feb9a6ddf39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9cb1c76-d416-4a83-802e-feb9a6ddf39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10fcbc8f-afe7-40e4-b6d4-08deef2414e5', 'volume_name': 'volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f80a3b-4764-4dec-8838-e768c28efd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f80a3b-4764-4dec-8838-e768c28efd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f02ef97-e8d2-44a9-afbb-9624f81b1888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:19 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Volume 10fcbc8f-afe7-40e4-b6d4-08deef2414e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5', 'volume_size': 1} Jul 06 21:11:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:20 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7019980d-315d-4ba2-99f9-ea06dd9198d2" returned: 0 in 0.636s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Lock "cinder-quobyte-7019980d-315d-4ba2-99f9-ea06dd9198d2" released by "_copy_volume_from_snapshot" :: held 8.126s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Lock "cinder-quobyte-92d035c9-68ec-4d2f-908c-f2bc36ea620d-7019980d-315d-4ba2-99f9-ea06dd9198d2" released by "_create_volume_from_snapshot" :: held 8.169s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.206s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.896s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] Creating offline snapshot 66f2a9cc-12c4-41d5-aff4-5066c7d898d2 of volume 2f24c983-db97-4d5b-ba2c-b1677a7719e9 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee77aff2-be35-486b-b0a1-99a1b9f9f3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7019980d-315d-4ba2-99f9-ea06dd9198d2', 'volume_size': 1, 'snapshot_id': '92d035c9-68ec-4d2f-908c-f2bc36ea620d'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467f35a2-b7e5-4aad-b8df-0edce8994f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c011fff-170d-44ea-b1aa-c20d0e3f0a5c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:20 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Volume volume-7019980d-315d-4ba2-99f9-ea06dd9198d2 (7019980d-315d-4ba2-99f9-ea06dd9198d2): created successfully Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467f35a2-b7e5-4aad-b8df-0edce8994f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Flow 'volume_create_manager' (d4deedad-4390-4092-9c50-313ae26e2d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:20 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e6c88d82-5341-41e0-9c1b-10f7c498298f tempest-VolumeDependencyTests-2062767927 None] Created volume successfully. Jul 06 21:11:20 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 Jul 06 21:11:20 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] Acquiring lock "cinder-92d035c9-68ec-4d2f-908c-f2bc36ea620d-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] Lock "cinder-92d035c9-68ec-4d2f-908c-f2bc36ea620d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] Acquiring lock "cinder-quobyte-f05984c2-00fb-4901-be22-4ed0bb6c17b0" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] Lock "cinder-quobyte-f05984c2-00fb-4901-be22-4ed0bb6c17b0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] Acquiring lock "cinder-quobyte-92d035c9-68ec-4d2f-908c-f2bc36ea620d" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] Lock "cinder-quobyte-92d035c9-68ec-4d2f-908c-f2bc36ea620d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] Deleting offline snapshot 92d035c9-68ec-4d2f-908c-f2bc36ea620d of volume f05984c2-00fb-4901-be22-4ed0bb6c17b0 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] snapshot_file for this snap is: volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9982faf-e1a9-4fb8-829f-c01930a8831e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:20 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d Jul 06 21:11:20 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:20 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9" returned: 0 in 0.737s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:20 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2 1G Jul 06 21:11:20 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:21 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d" returned: 0 in 0.778s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:21 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:11:21 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a33830-c234-4af4-94a6-5f7ea6864500]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:21 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 Jul 06 21:11:21 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:21 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2 1G" returned: 0 in 0.856s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:21 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2 Jul 06 21:11:21 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:22 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0" returned: 0 in 0.826s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:22 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d Jul 06 21:11:22 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:22 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2" returned: 0 in 0.794s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:22 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2 is being set with open permissions: ugo+rw Jul 06 21:11:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:22 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2 Jul 06 21:11:22 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:23 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d" returned: 0 in 0.751s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:23 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d Jul 06 21:11:23 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:23 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2" returned: 0 in 0.682s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:23 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.info Jul 06 21:11:23 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:23 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0.92d035c9-68ec-4d2f-908c-f2bc36ea620d" returned: 0 in 0.709s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] Lock "cinder-quobyte-92d035c9-68ec-4d2f-908c-f2bc36ea620d" released by "_delete_snapshot" :: held 3.193s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] Lock "cinder-quobyte-f05984c2-00fb-4901-be22-4ed0bb6c17b0" released by "delete_snapshot" :: held 3.218s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:23 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.info" returned: 0 in 0.660s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:23 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.info is being set with open permissions: ugo+rw Jul 06 21:11:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:23 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.info Jul 06 21:11:23 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:24 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] Created reservations ['2cdf0ab7-de34-444d-ad0d-342bd862cd7a', '36199828-e82f-43b2-80f4-197ea921e499', '8c4b82ff-7ee5-42c6-82a8-6b1b862ff4b9', '92399208-f04e-4335-9d06-6ac18f7bd093'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:11:24 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] Delete snapshot completed successfully. Jul 06 21:11:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-bc4a35ca-ddc2-4650-bc21-364eff0c359d tempest-VolumeDependencyTests-2062767927 None] Lock "cinder-92d035c9-68ec-4d2f-908c-f2bc36ea620d-delete_snapshot" released by "delete_snapshot" :: held 3.366s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:24 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.info" returned: 0 in 0.647s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.486s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.783s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-106591342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fcbc8f-afe7-40e4-b6d4-08deef2414e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf91a4684da044db85c6285e8ceb955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:20Z,use_quota=True,user_id='193f18baf5d94bb9a2b8367616b42f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:11:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Creating volume 10fcbc8f-afe7-40e4-b6d4-08deef2414e5 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:11:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:11:24 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:11:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:24 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5 1073741824 Jul 06 21:11:24 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:24 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0052444c-3bdc-4caf-b34c-2067a1005734 tempest-SnapshotDependencyTests-220526978 None] Create snapshot completed successfully Jul 06 21:11:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] Acquiring lock "cinder-f05984c2-00fb-4901-be22-4ed0bb6c17b0-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] Lock "cinder-f05984c2-00fb-4901-be22-4ed0bb6c17b0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] Acquiring lock "cinder-quobyte-f05984c2-00fb-4901-be22-4ed0bb6c17b0" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] Lock "cinder-quobyte-f05984c2-00fb-4901-be22-4ed0bb6c17b0" acquired by "delete_volume" :: waited 0.027s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6871f70-b30e-462d-ae87-a879b6bee125]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:25 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 Jul 06 21:11:25 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Flow 'volume_create_manager' (aba63996-3b71-4491-be56-9a36ea55867e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea178faa-1b94-46c7-9506-ddb26e2d7872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:25 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5 1073741824" returned: 0 in 0.907s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea178faa-1b94-46c7-9506-ddb26e2d7872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f457d90-4826-49a1-a6ed-59381bceb5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80690609554a4d963b933edd407180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=66f2a9cc-12c4-41d5-aff4-5066c7d898d2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:25Z,use_quota=True,user_id='bbe26faf12eb47158f31b0e3462ca501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5efb87eb-ab6b-461a-81ad-75b0c2627cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5efb87eb-ab6b-461a-81ad-75b0c2627cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8141838d-3e50-4173-9f49-0ddeb50f8a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8141838d-3e50-4173-9f49-0ddeb50f8a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3f457d90-4826-49a1-a6ed-59381bceb5f2', 'volume_name': 'volume-3f457d90-4826-49a1-a6ed-59381bceb5f2', 'volume_size': 1, 'snapshot_id': '66f2a9cc-12c4-41d5-aff4-5066c7d898d2'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b1f002b-9d73-4278-b683-20835a2fa9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b1f002b-9d73-4278-b683-20835a2fa9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deaad519-566d-4b8e-ad32-34c36a017726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:25 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Volume 3f457d90-4826-49a1-a6ed-59381bceb5f2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3f457d90-4826-49a1-a6ed-59381bceb5f2', 'volume_size': 1, 'snapshot_id': '66f2a9cc-12c4-41d5-aff4-5066c7d898d2'} Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:25 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5 Jul 06 21:11:25 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:25 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0" returned: 0 in 0.813s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:25 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0 Jul 06 21:11:25 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:26 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5" returned: 0 in 0.654s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.679s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Acquiring lock "cinder-quobyte-66f2a9cc-12c4-41d5-aff4-5066c7d898d2-3f457d90-4826-49a1-a6ed-59381bceb5f2" by "_create_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f02ef97-e8d2-44a9-afbb-9624f81b1888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261e105d-aee8-4273-85ad-1943f8da6057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Lock "cinder-quobyte-66f2a9cc-12c4-41d5-aff4-5066c7d898d2-3f457d90-4826-49a1-a6ed-59381bceb5f2" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Creating volume 3f457d90-4826-49a1-a6ed-59381bceb5f2 from snapshot 66f2a9cc-12c4-41d5-aff4-5066c7d898d2 {{(pid=87207) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Acquiring lock "cinder-quobyte-3f457d90-4826-49a1-a6ed-59381bceb5f2" by "_copy_volume_from_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:26 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Volume volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5 (10fcbc8f-afe7-40e4-b6d4-08deef2414e5): created successfully Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261e105d-aee8-4273-85ad-1943f8da6057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Flow 'volume_create_manager' (17427fef-1c98-40ce-aac8-858019f3720d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Lock "cinder-quobyte-3f457d90-4826-49a1-a6ed-59381bceb5f2" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] snapshot: 66f2a9cc-12c4-41d5-aff4-5066c7d898d2, volume: 3f457d90-4826-49a1-a6ed-59381bceb5f2, {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 21:11:26 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-ee7715b3-d10c-429b-a58c-3f11b0036856 tempest-ProjectMemberTests-464659054 None] Created volume successfully. Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd7ce7b-7ec3-472a-98b5-15744fc0b148]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:26 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2 Jul 06 21:11:26 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:26 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f05984c2-00fb-4901-be22-4ed0bb6c17b0" returned: 0 in 0.749s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] Lock "cinder-quobyte-f05984c2-00fb-4901-be22-4ed0bb6c17b0" released by "delete_volume" :: held 1.654s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] Created reservations ['a8d1838c-2f39-4cd2-bedc-38d2d1bb2f96', '1c237f6f-8d78-425f-b3b6-613ade75098c', 'e88f2530-6dd4-45e0-8492-e63e6e0ad617', '8741a9dc-6e6c-42e1-a598-e7c72900c659'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:26 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:11:26 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:27 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2" returned: 0 in 0.811s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:27 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:11:27 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 21:11:27 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Creating direct copy from snapshot {{(pid=87207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 21:11:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] Acquiring lock "cinder-7019980d-315d-4ba2-99f9-ea06dd9198d2-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:27 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7e8fb1-ce23-4744-9e38-4fe1f8cf595c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] Lock "cinder-7019980d-315d-4ba2-99f9-ea06dd9198d2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] Acquiring lock "cinder-quobyte-7019980d-315d-4ba2-99f9-ea06dd9198d2" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] Lock "cinder-quobyte-7019980d-315d-4ba2-99f9-ea06dd9198d2" acquired by "delete_volume" :: waited 0.037s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:27 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 Jul 06 21:11:27 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:27 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0f0428-3d6d-439e-996d-d0cb9559d686]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7019980d-315d-4ba2-99f9-ea06dd9198d2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:27 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:27 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7019980d-315d-4ba2-99f9-ea06dd9198d2 Jul 06 21:11:27 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.794s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:27 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:11:27 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] Deleted volume successfully. Jul 06 21:11:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-19a15813-62b6-4575-8c2f-8a651fff4226 tempest-VolumeDependencyTests-2062767927 None] Lock "cinder-f05984c2-00fb-4901-be22-4ed0bb6c17b0-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:28 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9" returned: 0 in 0.926s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:28 devstack cinder-volume[87207]: DEBUG cinder.utils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Path /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3f457d90-4826-49a1-a6ed-59381bceb5f2 not found in is_blk_device check {{(pid=87207) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 21:11:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3f457d90-4826-49a1-a6ed-59381bceb5f2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:28 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3f457d90-4826-49a1-a6ed-59381bceb5f2 Jul 06 21:11:28 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:28 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7019980d-315d-4ba2-99f9-ea06dd9198d2" returned: 0 in 0.887s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7019980d-315d-4ba2-99f9-ea06dd9198d2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:28 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7019980d-315d-4ba2-99f9-ea06dd9198d2 Jul 06 21:11:28 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:29 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-7019980d-315d-4ba2-99f9-ea06dd9198d2" returned: 0 in 0.726s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:29 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] Lock "cinder-quobyte-7019980d-315d-4ba2-99f9-ea06dd9198d2" released by "delete_volume" :: held 1.684s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:29 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] Created reservations ['4c1bc61a-fbc9-4621-b1c8-941f94fc1f2c', 'a509e0d4-4953-44fd-b16a-f14415e8e779', 'bef41359-ea75-4c65-9a51-5f5d7faed3ac', 'f72d64a0-a028-44dc-9a2a-69546b9d8e82'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:11:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:29 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:29 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:29 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:11:29 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:30 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.212s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:30 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:11:30 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] Deleted volume successfully. Jul 06 21:11:30 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-48ff8a15-30e8-4233-9aae-c667d72da0c6 tempest-VolumeDependencyTests-2062767927 None] Lock "cinder-7019980d-315d-4ba2-99f9-ea06dd9198d2-delete_volume" released by "delete_volume" :: held 3.364s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:33 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3f457d90-4826-49a1-a6ed-59381bceb5f2" returned: 0 in 5.360s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:33 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1f485f-f46a-41c5-af11-b6460fea5b63]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:33 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 Jul 06 21:11:33 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:34 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9" returned: 0 in 0.929s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:34 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Image conversion details: src /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3f457d90-4826-49a1-a6ed-59381bceb5f2 {{(pid=87207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:11:34 devstack cinder-volume[87207]: INFO cinder.image.image_utils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Converted 1024.00 MB image at 190.99 MB/s Jul 06 21:11:34 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3f457d90-4826-49a1-a6ed-59381bceb5f2 is being set with open permissions: ugo+rw Jul 06 21:11:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3f457d90-4826-49a1-a6ed-59381bceb5f2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:34 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3f457d90-4826-49a1-a6ed-59381bceb5f2 Jul 06 21:11:34 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:35 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3f457d90-4826-49a1-a6ed-59381bceb5f2" returned: 0 in 0.629s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Lock "cinder-quobyte-3f457d90-4826-49a1-a6ed-59381bceb5f2" released by "_copy_volume_from_snapshot" :: held 8.793s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Lock "cinder-quobyte-66f2a9cc-12c4-41d5-aff4-5066c7d898d2-3f457d90-4826-49a1-a6ed-59381bceb5f2" released by "_create_volume_from_snapshot" :: held 8.842s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.878s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.575s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] Creating offline snapshot 72a62f27-5852-435a-aeab-5ee3d6ec3f42 of volume 10fcbc8f-afe7-40e4-b6d4-08deef2414e5 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deaad519-566d-4b8e-ad32-34c36a017726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f457d90-4826-49a1-a6ed-59381bceb5f2', 'volume_size': 1, 'snapshot_id': '66f2a9cc-12c4-41d5-aff4-5066c7d898d2'}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bca8eb-40de-40b8-b822-7f2b61bd8813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b485294-eeea-415b-9031-018b11fcd75b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:35 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Volume volume-3f457d90-4826-49a1-a6ed-59381bceb5f2 (3f457d90-4826-49a1-a6ed-59381bceb5f2): created successfully Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bca8eb-40de-40b8-b822-7f2b61bd8813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Flow 'volume_create_manager' (aba63996-3b71-4491-be56-9a36ea55867e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:35 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-b2cc69d6-1abf-472b-9cc3-b45d12007d40 tempest-SnapshotDependencyTests-220526978 None] Created volume successfully. Jul 06 21:11:35 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5 Jul 06 21:11:35 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] Acquiring lock "cinder-66f2a9cc-12c4-41d5-aff4-5066c7d898d2-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] Lock "cinder-66f2a9cc-12c4-41d5-aff4-5066c7d898d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] Acquiring lock "cinder-quobyte-2f24c983-db97-4d5b-ba2c-b1677a7719e9" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] Lock "cinder-quobyte-2f24c983-db97-4d5b-ba2c-b1677a7719e9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] Acquiring lock "cinder-quobyte-66f2a9cc-12c4-41d5-aff4-5066c7d898d2" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] Lock "cinder-quobyte-66f2a9cc-12c4-41d5-aff4-5066c7d898d2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] Deleting offline snapshot 66f2a9cc-12c4-41d5-aff4-5066c7d898d2 of volume 2f24c983-db97-4d5b-ba2c-b1677a7719e9 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] snapshot_file for this snap is: volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[76637773-dcec-486d-b190-b6091d490dea]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:35 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2 Jul 06 21:11:35 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:36 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5" returned: 0 in 0.798s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:36 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42 1G Jul 06 21:11:36 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:36 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2" returned: 0 in 0.785s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:36 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:11:36 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03f3b88-cd49-4841-b95c-9b7ef176800d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:36 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 Jul 06 21:11:36 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:36 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42 1G" returned: 0 in 0.900s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:36 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42 Jul 06 21:11:36 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:37 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9" returned: 0 in 0.826s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:37 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2 Jul 06 21:11:37 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:37 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42" returned: 0 in 0.846s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:37 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42 is being set with open permissions: ugo+rw Jul 06 21:11:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:37 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42 Jul 06 21:11:37 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:38 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2" returned: 0 in 0.815s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:38 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2 Jul 06 21:11:38 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:38 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42" returned: 0 in 0.740s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:38 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=132,cinder:INSERT=42,cinder:UPDATE=160,cinder:DELETE=17 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:11:38 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:DELETE=11,cinder:UPDATE=169,cinder:SELECT=111,cinder:INSERT=41 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:11:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:38 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.info Jul 06 21:11:38 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:38 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9.66f2a9cc-12c4-41d5-aff4-5066c7d898d2" returned: 0 in 0.702s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] Lock "cinder-quobyte-66f2a9cc-12c4-41d5-aff4-5066c7d898d2" released by "_delete_snapshot" :: held 3.240s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] Lock "cinder-quobyte-2f24c983-db97-4d5b-ba2c-b1677a7719e9" released by "delete_snapshot" :: held 3.262s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:38 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] Created reservations ['0f6d5c7f-ed96-4454-89ff-3b0e08777956', '93b13a21-59fd-45a1-a86b-9602b0a5ec1f', 'bd17a731-57cb-48d5-b48f-580357e757a3', '487b7836-b65b-41d8-b9f3-56959325979b'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:11:38 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] Delete snapshot completed successfully. Jul 06 21:11:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e2c70b2c-17f0-4ebc-95c8-8e50abae4678 tempest-SnapshotDependencyTests-220526978 None] Lock "cinder-66f2a9cc-12c4-41d5-aff4-5066c7d898d2-delete_snapshot" released by "delete_snapshot" :: held 3.404s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:39 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.info" returned: 0 in 0.742s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:39 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.info is being set with open permissions: ugo+rw Jul 06 21:11:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:39 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.info Jul 06 21:11:39 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] Acquiring lock "cinder-2f24c983-db97-4d5b-ba2c-b1677a7719e9-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] Lock "cinder-2f24c983-db97-4d5b-ba2c-b1677a7719e9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] Acquiring lock "cinder-quobyte-2f24c983-db97-4d5b-ba2c-b1677a7719e9" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] Lock "cinder-quobyte-2f24c983-db97-4d5b-ba2c-b1677a7719e9" acquired by "delete_volume" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:39 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a75058b-c671-4bf0-9ffe-c7d92945c94d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:39 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.info" returned: 0 in 0.675s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.828s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:40 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-a1a01478-a5e7-4b60-8c4b-f8c73a71799e tempest-ProjectMemberTests-464659054 None] Create snapshot completed successfully Jul 06 21:11:40 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 Jul 06 21:11:40 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-72a62f27-5852-435a-aeab-5ee3d6ec3f42-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] Lock "cinder-72a62f27-5852-435a-aeab-5ee3d6ec3f42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-10fcbc8f-afe7-40e4-b6d4-08deef2414e5" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-10fcbc8f-afe7-40e4-b6d4-08deef2414e5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-72a62f27-5852-435a-aeab-5ee3d6ec3f42" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-72a62f27-5852-435a-aeab-5ee3d6ec3f42" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] Deleting offline snapshot 72a62f27-5852-435a-aeab-5ee3d6ec3f42 of volume 10fcbc8f-afe7-40e4-b6d4-08deef2414e5 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:11:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] snapshot_file for this snap is: volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:11:40 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02e3e47-d445-4b60-902e-aa50d3384fc5]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:40 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42 Jul 06 21:11:40 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:40 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9" returned: 0 in 0.879s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:40 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9 Jul 06 21:11:40 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:41 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42" returned: 0 in 0.763s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:41 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:11:41 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d083a659-6859-4303-83a9-97261bef8b44]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:41 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5 Jul 06 21:11:41 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:41 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-2f24c983-db97-4d5b-ba2c-b1677a7719e9" returned: 0 in 0.666s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:41 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] Lock "cinder-quobyte-2f24c983-db97-4d5b-ba2c-b1677a7719e9" released by "delete_volume" :: held 1.612s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:41 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] Created reservations ['47e44590-5918-4dd0-ace2-ebc321ddbf72', 'a003c7cf-49fc-49e5-af80-d4770c477fdc', '8974a703-a690-49e0-976c-ed1c2b4e94ec', 'b8c89be4-f030-4bbe-a3c2-e7755f1ebec8'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:11:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:41 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:41 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:41 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:11:41 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:41 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5" returned: 0 in 0.780s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:41 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42 Jul 06 21:11:41 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] Acquiring lock "cinder-3f457d90-4826-49a1-a6ed-59381bceb5f2-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] Lock "cinder-3f457d90-4826-49a1-a6ed-59381bceb5f2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] Acquiring lock "cinder-quobyte-3f457d90-4826-49a1-a6ed-59381bceb5f2" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] Lock "cinder-quobyte-3f457d90-4826-49a1-a6ed-59381bceb5f2" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:42 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2c9cbb-4fcc-4f0c-9a7a-7ec7da189ea2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3f457d90-4826-49a1-a6ed-59381bceb5f2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:42 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3f457d90-4826-49a1-a6ed-59381bceb5f2 Jul 06 21:11:42 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:42 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.851s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:42 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:11:42 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] Deleted volume successfully. Jul 06 21:11:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-075f8318-5f9f-4dd0-b45a-0e55f453797d tempest-SnapshotDependencyTests-220526978 None] Lock "cinder-2f24c983-db97-4d5b-ba2c-b1677a7719e9-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:42 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42" returned: 0 in 0.891s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:42 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42 Jul 06 21:11:42 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:43 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3f457d90-4826-49a1-a6ed-59381bceb5f2" returned: 0 in 0.880s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3f457d90-4826-49a1-a6ed-59381bceb5f2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:43 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3f457d90-4826-49a1-a6ed-59381bceb5f2 Jul 06 21:11:43 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:43 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5.72a62f27-5852-435a-aeab-5ee3d6ec3f42" returned: 0 in 0.719s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-72a62f27-5852-435a-aeab-5ee3d6ec3f42" released by "_delete_snapshot" :: held 3.247s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-10fcbc8f-afe7-40e4-b6d4-08deef2414e5" released by "delete_snapshot" :: held 3.282s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:43 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] Created reservations ['a41a238d-2789-4905-9916-94b85b2cd7c4', '7ffef476-6424-4aba-810c-cb6da915c51f', 'c43fcc6f-5e4c-4d50-8022-33cbe0d73b03', '0f1febe8-872e-4ee5-b627-f7906a06e7f0'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:11:43 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] Delete snapshot completed successfully. Jul 06 21:11:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b4549700-6dfa-405d-a375-50e864f0d804 tempest-ProjectMemberTests-464659054 None] Lock "cinder-72a62f27-5852-435a-aeab-5ee3d6ec3f42-delete_snapshot" released by "delete_snapshot" :: held 3.447s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:43 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-3f457d90-4826-49a1-a6ed-59381bceb5f2" returned: 0 in 0.664s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] Lock "cinder-quobyte-3f457d90-4826-49a1-a6ed-59381bceb5f2" released by "delete_volume" :: held 1.595s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:43 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] Created reservations ['8edb362b-5b58-47b6-afb4-c5c813c32d71', 'e5a0adda-74ad-4303-a70f-41ecf106d8d8', '56e7e370-f4c6-40f0-92d3-53d8e0a57dd8', '06c60045-01ae-44b5-ac24-abe641b424ab'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:11:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:43 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:11:43 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-10fcbc8f-afe7-40e4-b6d4-08deef2414e5-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] Lock "cinder-10fcbc8f-afe7-40e4-b6d4-08deef2414e5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-10fcbc8f-afe7-40e4-b6d4-08deef2414e5" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-10fcbc8f-afe7-40e4-b6d4-08deef2414e5" acquired by "delete_volume" :: waited 0.026s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:44 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfd6ee7-d709-4386-872d-ae1f7ebbf7a5]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:44 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.863s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:44 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:11:44 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] Deleted volume successfully. Jul 06 21:11:44 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-12869872-4acb-4397-9640-a53334033b62 tempest-SnapshotDependencyTests-220526978 None] Lock "cinder-3f457d90-4826-49a1-a6ed-59381bceb5f2-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:44 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5 Jul 06 21:11:44 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:45 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5" returned: 0 in 0.944s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:45 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5 Jul 06 21:11:45 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:46 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-10fcbc8f-afe7-40e4-b6d4-08deef2414e5" returned: 0 in 0.738s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:46 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-10fcbc8f-afe7-40e4-b6d4-08deef2414e5" released by "delete_volume" :: held 1.759s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:46 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] Created reservations ['d07dc65e-bb49-4497-b28e-e19520508d11', '765f54e5-0afb-4d32-858b-7fa21cf6a2cd', '4be43dfb-44c6-434c-bcef-77d8e0c1f757', 'f1d09022-c94a-49fe-af78-e54ff2f6a254'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:11:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:46 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:11:46 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Flow 'volume_create_manager' (3d5f0301-b80b-41c4-b039-2c77827ac2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aef94fb-957c-4589-8d5f-7d56b26707cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aef94fb-957c-4589-8d5f-7d56b26707cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-55391816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761c7b1b-716e-4144-b011-d44bf0e657a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf91a4684da044db85c6285e8ceb955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:47Z,use_quota=True,user_id='193f18baf5d94bb9a2b8367616b42f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a70024e-9dc2-4a62-b369-e3cbf613fa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a70024e-9dc2-4a62-b369-e3cbf613fa76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59ab7f9-7019-42b4-aa24-7b3f5ab5a510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59ab7f9-7019-42b4-aa24-7b3f5ab5a510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '761c7b1b-716e-4144-b011-d44bf0e657a7', 'volume_name': 'volume-761c7b1b-716e-4144-b011-d44bf0e657a7', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:47 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a287e69-2dbf-4ed5-83fe-74d11cc22f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a287e69-2dbf-4ed5-83fe-74d11cc22f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db60d44a-5ad8-4825-8693-0d834894b6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:47 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Volume 761c7b1b-716e-4144-b011-d44bf0e657a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-761c7b1b-716e-4144-b011-d44bf0e657a7', 'volume_size': 1} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-55391816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761c7b1b-716e-4144-b011-d44bf0e657a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf91a4684da044db85c6285e8ceb955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:47Z,use_quota=True,user_id='193f18baf5d94bb9a2b8367616b42f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Creating volume 761c7b1b-716e-4144-b011-d44bf0e657a7 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:11:47 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 1.069s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:11:47 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] Deleted volume successfully. Jul 06 21:11:47 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7 1073741824 Jul 06 21:11:47 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:47 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3f539470-80ca-49bb-a004-da32a1b6c97c tempest-ProjectMemberTests-464659054 None] Lock "cinder-10fcbc8f-afe7-40e4-b6d4-08deef2414e5-delete_volume" released by "delete_volume" :: held 3.150s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:48 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7 1073741824" returned: 0 in 1.188s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:48 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7 Jul 06 21:11:48 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:49 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7" returned: 0 in 0.765s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] <== create_volume: return (2002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:11:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db60d44a-5ad8-4825-8693-0d834894b6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-761c7b1b-716e-4144-b011-d44bf0e657a7', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d199955-2999-474c-949e-41af16171961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:49 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Volume volume-761c7b1b-716e-4144-b011-d44bf0e657a7 (761c7b1b-716e-4144-b011-d44bf0e657a7): created successfully Jul 06 21:11:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d199955-2999-474c-949e-41af16171961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:49 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Flow 'volume_create_manager' (3d5f0301-b80b-41c4-b039-2c77827ac2b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:49 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-96f8da78-13bb-4b51-9f5d-07b06840afca tempest-ProjectMemberTests-464659054 None] Created volume successfully. Jul 06 21:11:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] Creating offline snapshot e9458967-d464-4b19-9674-f74cd0beda54 of volume 761c7b1b-716e-4144-b011-d44bf0e657a7 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:11:51 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bf6d48-5506-4926-a47e-9e7f30879168]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:51 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7 Jul 06 21:11:51 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:51 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7" returned: 0 in 0.793s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:51 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54 1G Jul 06 21:11:51 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:52 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54 1G" returned: 0 in 0.936s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-761c7b1b-716e-4144-b011-d44bf0e657a7 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:52 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-761c7b1b-716e-4144-b011-d44bf0e657a7 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54 Jul 06 21:11:52 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:53 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-761c7b1b-716e-4144-b011-d44bf0e657a7 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54" returned: 0 in 0.811s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:53 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54 is being set with open permissions: ugo+rw Jul 06 21:11:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:53 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54 Jul 06 21:11:53 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:54 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54" returned: 0 in 0.747s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:54 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.info Jul 06 21:11:54 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:55 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.info" returned: 0 in 0.678s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:55 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.info is being set with open permissions: ugo+rw Jul 06 21:11:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:55 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.info Jul 06 21:11:55 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:55 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.info" returned: 0 in 0.673s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.753s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:55 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-c0c25790-1477-44f7-84f6-58097d4a38f3 tempest-ProjectMemberTests-464659054 None] Create snapshot completed successfully Jul 06 21:11:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-e9458967-d464-4b19-9674-f74cd0beda54-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] Lock "cinder-e9458967-d464-4b19-9674-f74cd0beda54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-761c7b1b-716e-4144-b011-d44bf0e657a7" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-761c7b1b-716e-4144-b011-d44bf0e657a7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-e9458967-d464-4b19-9674-f74cd0beda54" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-e9458967-d464-4b19-9674-f74cd0beda54" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] Deleting offline snapshot e9458967-d464-4b19-9674-f74cd0beda54 of volume 761c7b1b-716e-4144-b011-d44bf0e657a7 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:11:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] snapshot_file for this snap is: volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:11:56 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d4b817-6ca9-4e2c-960f-352254e3f491]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:56 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54 Jul 06 21:11:56 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:57 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54" returned: 0 in 0.738s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-761c7b1b-716e-4144-b011-d44bf0e657a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:11:57 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[169e2391-e7a4-4aa2-800e-caf2a1dff7f2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:57 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7 Jul 06 21:11:57 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:57 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7" returned: 0 in 0.774s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:57 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54 Jul 06 21:11:57 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:11:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:58 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:11:58 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:58 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54" returned: 0 in 0.791s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:58 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54 Jul 06 21:11:58 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:58 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.660s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:11:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:11:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 29 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:11:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:11:59 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7.e9458967-d464-4b19-9674-f74cd0beda54" returned: 0 in 0.623s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-e9458967-d464-4b19-9674-f74cd0beda54" released by "_delete_snapshot" :: held 3.024s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-761c7b1b-716e-4144-b011-d44bf0e657a7" released by "delete_snapshot" :: held 3.045s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:59 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] Created reservations ['c264db07-86f5-4cab-a00a-8245e25c696f', '3edd31cb-c697-4482-b68c-55e531b54491', '0d980709-36bb-49de-bc8f-60761aa59069', 'c3746b86-f073-49af-bc41-9f427a702f3b'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:11:59 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] Delete snapshot completed successfully. Jul 06 21:11:59 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-c8266fba-65c2-41bf-8a66-a21532974624 tempest-ProjectMemberTests-464659054 None] Lock "cinder-e9458967-d464-4b19-9674-f74cd0beda54-delete_snapshot" released by "delete_snapshot" :: held 3.185s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-761c7b1b-716e-4144-b011-d44bf0e657a7-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] Lock "cinder-761c7b1b-716e-4144-b011-d44bf0e657a7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-761c7b1b-716e-4144-b011-d44bf0e657a7" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-761c7b1b-716e-4144-b011-d44bf0e657a7" acquired by "delete_volume" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:00 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e837edd-c446-49d8-8368-a8e9cd67f915]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:00 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7 Jul 06 21:12:00 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:01 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7" returned: 0 in 0.717s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:01 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7 Jul 06 21:12:01 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:01 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-761c7b1b-716e-4144-b011-d44bf0e657a7" returned: 0 in 0.679s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:01 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-761c7b1b-716e-4144-b011-d44bf0e657a7" released by "delete_volume" :: held 1.452s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:02 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] Created reservations ['c77803a9-d853-4384-8998-102407025237', '8edee23a-ef42-4f78-b590-b41b321afcea', '16b89cca-b496-4fea-89a8-ebb75b18f2da', '5b7ad7cf-abeb-4f78-a094-6060f38adfe3'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:12:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:02 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:12:02 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:02 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.715s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:02 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:12:02 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] Deleted volume successfully. Jul 06 21:12:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0d964e5f-55cb-42ab-9a7c-21c9a66a11d6 tempest-ProjectMemberTests-464659054 None] Lock "cinder-761c7b1b-716e-4144-b011-d44bf0e657a7-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Flow 'volume_create_manager' (07ae2c87-75d0-4622-a35e-4c386403c88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f82b24-6bb6-4011-9a32-247a5fba5925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f82b24-6bb6-4011-9a32-247a5fba5925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1844070652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6d7304-b924-436a-96e9-ca5093b8518b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf91a4684da044db85c6285e8ceb955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:03Z,use_quota=True,user_id='193f18baf5d94bb9a2b8367616b42f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf47b80-23ed-45d6-9d36-efca8e3a857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf47b80-23ed-45d6-9d36-efca8e3a857c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755eae3a-3753-4bd9-9b74-d97ee6c00660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755eae3a-3753-4bd9-9b74-d97ee6c00660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba6d7304-b924-436a-96e9-ca5093b8518b', 'volume_name': 'volume-ba6d7304-b924-436a-96e9-ca5093b8518b', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d22637-cd27-4d8c-a51d-f605daa4c8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d22637-cd27-4d8c-a51d-f605daa4c8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30395374-703c-413d-9df0-56c5f613aaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:03 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Volume ba6d7304-b924-436a-96e9-ca5093b8518b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba6d7304-b924-436a-96e9-ca5093b8518b', 'volume_size': 1} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1844070652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6d7304-b924-436a-96e9-ca5093b8518b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf91a4684da044db85c6285e8ceb955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:03Z,use_quota=True,user_id='193f18baf5d94bb9a2b8367616b42f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Creating volume ba6d7304-b924-436a-96e9-ca5093b8518b {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:12:03 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:12:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:03 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b 1073741824 Jul 06 21:12:03 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:04 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b 1073741824" returned: 0 in 0.802s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:04 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b Jul 06 21:12:04 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:04 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b" returned: 0 in 0.616s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:04 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:12:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30395374-703c-413d-9df0-56c5f613aaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba6d7304-b924-436a-96e9-ca5093b8518b', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ef50a3-cadd-4ab2-9777-bd6ad74d72e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:04 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Volume volume-ba6d7304-b924-436a-96e9-ca5093b8518b (ba6d7304-b924-436a-96e9-ca5093b8518b): created successfully Jul 06 21:12:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ef50a3-cadd-4ab2-9777-bd6ad74d72e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:04 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Flow 'volume_create_manager' (07ae2c87-75d0-4622-a35e-4c386403c88b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:12:04 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-b3fc0f1e-95a1-46d4-b387-350fafd74884 tempest-ProjectMemberTests-464659054 None] Created volume successfully. Jul 06 21:12:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] Creating offline snapshot 8204ad6e-8dbe-491f-8667-297bd3c2a7f2 of volume ba6d7304-b924-436a-96e9-ca5093b8518b {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:12:05 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaf085e-5103-4a5f-a62e-d46769455dab]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:05 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b Jul 06 21:12:05 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:06 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b" returned: 0 in 0.775s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:06 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2 1G Jul 06 21:12:06 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:06 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2 1G" returned: 0 in 0.783s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba6d7304-b924-436a-96e9-ca5093b8518b -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:06 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba6d7304-b924-436a-96e9-ca5093b8518b -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2 Jul 06 21:12:06 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:07 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba6d7304-b924-436a-96e9-ca5093b8518b -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2" returned: 0 in 0.657s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:07 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2 is being set with open permissions: ugo+rw Jul 06 21:12:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:07 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2 Jul 06 21:12:07 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:08 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2" returned: 0 in 0.609s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:08 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.info Jul 06 21:12:08 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:08 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.info" returned: 0 in 0.631s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:08 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.info is being set with open permissions: ugo+rw Jul 06 21:12:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:08 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.info Jul 06 21:12:08 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:09 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.info" returned: 0 in 0.788s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.325s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:09 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f2102aa3-4f58-4e48-ba2d-9c98b84cec73 tempest-ProjectMemberTests-464659054 None] Create snapshot completed successfully Jul 06 21:12:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-8204ad6e-8dbe-491f-8667-297bd3c2a7f2-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] Lock "cinder-8204ad6e-8dbe-491f-8667-297bd3c2a7f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-ba6d7304-b924-436a-96e9-ca5093b8518b" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-ba6d7304-b924-436a-96e9-ca5093b8518b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-8204ad6e-8dbe-491f-8667-297bd3c2a7f2" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-8204ad6e-8dbe-491f-8667-297bd3c2a7f2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] Deleting offline snapshot 8204ad6e-8dbe-491f-8667-297bd3c2a7f2 of volume ba6d7304-b924-436a-96e9-ca5093b8518b {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:12:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] snapshot_file for this snap is: volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:12:10 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ee7167-4008-48ba-8ff1-a019238d0bba]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:10 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2 Jul 06 21:12:10 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:11 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2" returned: 0 in 0.783s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba6d7304-b924-436a-96e9-ca5093b8518b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:12:11 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9f3752-5cb7-4194-a427-9d1f985c7ba6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:11 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b Jul 06 21:12:11 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:12 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b" returned: 0 in 0.778s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:12 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2 Jul 06 21:12:12 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:13 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2" returned: 0 in 0.746s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:13 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2 Jul 06 21:12:13 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:13 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b.8204ad6e-8dbe-491f-8667-297bd3c2a7f2" returned: 0 in 0.687s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:13 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-8204ad6e-8dbe-491f-8667-297bd3c2a7f2" released by "_delete_snapshot" :: held 3.083s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:13 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-ba6d7304-b924-436a-96e9-ca5093b8518b" released by "delete_snapshot" :: held 3.106s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:13 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] Created reservations ['26ad80bd-b0fb-45a7-82b0-98eac9abdc48', '1b82727c-aad9-4d02-8a06-208acac07c92', 'd2867726-f432-4acb-95e1-bf8cc36bf88a', 'ef1261e6-d7ab-46f4-9cdb-e294a4aac76d'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:12:13 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] Delete snapshot completed successfully. Jul 06 21:12:13 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-ca881d85-51a1-4941-b648-bedb83cccb5f tempest-ProjectMemberTests-464659054 None] Lock "cinder-8204ad6e-8dbe-491f-8667-297bd3c2a7f2-delete_snapshot" released by "delete_snapshot" :: held 3.242s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-ba6d7304-b924-436a-96e9-ca5093b8518b-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] Lock "cinder-ba6d7304-b924-436a-96e9-ca5093b8518b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-ba6d7304-b924-436a-96e9-ca5093b8518b" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-ba6d7304-b924-436a-96e9-ca5093b8518b" acquired by "delete_volume" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:14 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7188f378-4a0c-4528-ad95-e112eb418f43]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:15 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b Jul 06 21:12:15 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:15 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b" returned: 0 in 0.758s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:15 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b Jul 06 21:12:15 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:16 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ba6d7304-b924-436a-96e9-ca5093b8518b" returned: 0 in 0.607s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:16 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-ba6d7304-b924-436a-96e9-ca5093b8518b" released by "delete_volume" :: held 1.418s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:16 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] Created reservations ['41bb28cc-de0d-4a08-a3f9-4f38305b58ec', '1de9b2b9-9a96-46d9-96e4-0a101c533398', 'e15449f7-8fa6-430b-b70c-62aa997a0640', '57cec9a3-2edb-4f94-b00d-32c9c829c839'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:12:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:16 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:16 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:12:16 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:17 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.605s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:12:17 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] Deleted volume successfully. Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a732709b-1026-4825-8e5a-68a6ce849110 tempest-ProjectMemberTests-464659054 None] Lock "cinder-ba6d7304-b924-436a-96e9-ca5093b8518b-delete_volume" released by "delete_volume" :: held 2.210s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Flow 'volume_create_manager' (bc2780b0-7119-4160-a030-d5a688f437b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a217c27f-e7a6-4c04-994b-21a4e4f50c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a217c27f-e7a6-4c04-994b-21a4e4f50c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1031291084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2003ac5-667f-4db2-9e00-e06f773197fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf91a4684da044db85c6285e8ceb955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:17Z,use_quota=True,user_id='193f18baf5d94bb9a2b8367616b42f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5dc577-c1c8-4a37-a9bb-54c9c1121728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5dc577-c1c8-4a37-a9bb-54c9c1121728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (491c2e15-82f7-4a8e-8e1d-47e2269c5cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (491c2e15-82f7-4a8e-8e1d-47e2269c5cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2003ac5-667f-4db2-9e00-e06f773197fa', 'volume_name': 'volume-a2003ac5-667f-4db2-9e00-e06f773197fa', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855686b3-d487-4380-b9e2-357144d005ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855686b3-d487-4380-b9e2-357144d005ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd4c55f-7efd-4073-99ed-bafae5e9b955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:17 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Volume a2003ac5-667f-4db2-9e00-e06f773197fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2003ac5-667f-4db2-9e00-e06f773197fa', 'volume_size': 1} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1031291084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2003ac5-667f-4db2-9e00-e06f773197fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf91a4684da044db85c6285e8ceb955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:17Z,use_quota=True,user_id='193f18baf5d94bb9a2b8367616b42f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Creating volume a2003ac5-667f-4db2-9e00-e06f773197fa {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:12:17 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:12:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:17 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa 1073741824 Jul 06 21:12:17 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:18 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa 1073741824" returned: 0 in 0.808s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:18 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa Jul 06 21:12:18 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:19 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa" returned: 0 in 0.619s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:19 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:12:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd4c55f-7efd-4073-99ed-bafae5e9b955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2003ac5-667f-4db2-9e00-e06f773197fa', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf1a568-92d8-4d06-a8eb-edffeb2e005d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:19 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Volume volume-a2003ac5-667f-4db2-9e00-e06f773197fa (a2003ac5-667f-4db2-9e00-e06f773197fa): created successfully Jul 06 21:12:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf1a568-92d8-4d06-a8eb-edffeb2e005d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:19 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Flow 'volume_create_manager' (bc2780b0-7119-4160-a030-d5a688f437b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:12:19 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-7169fed8-aad0-4534-b3a0-e3ccbc245bc8 tempest-ProjectMemberTests-464659054 None] Created volume successfully. Jul 06 21:12:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:19 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] Creating offline snapshot 92ba88ac-eb74-4217-aee4-2a5bab06c680 of volume a2003ac5-667f-4db2-9e00-e06f773197fa {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:12:19 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4c95c9-a55a-4115-916e-cb0d63bb73f3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:19 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa Jul 06 21:12:19 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:20 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa" returned: 0 in 0.723s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:20 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680 1G Jul 06 21:12:20 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:21 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680 1G" returned: 0 in 0.786s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2003ac5-667f-4db2-9e00-e06f773197fa -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:21 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2003ac5-667f-4db2-9e00-e06f773197fa -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680 Jul 06 21:12:21 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:21 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2003ac5-667f-4db2-9e00-e06f773197fa -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680" returned: 0 in 0.702s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:21 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680 is being set with open permissions: ugo+rw Jul 06 21:12:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:21 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680 Jul 06 21:12:21 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:22 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680" returned: 0 in 0.618s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:22 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.info Jul 06 21:12:22 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:23 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.info" returned: 0 in 0.679s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:23 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.info is being set with open permissions: ugo+rw Jul 06 21:12:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:23 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.info Jul 06 21:12:23 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:23 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.info" returned: 0 in 0.637s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.221s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:23 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-75f5bb9b-9dfd-4407-ad60-3d5efd164510 tempest-ProjectMemberTests-464659054 None] Create snapshot completed successfully Jul 06 21:12:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-92ba88ac-eb74-4217-aee4-2a5bab06c680-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] Lock "cinder-92ba88ac-eb74-4217-aee4-2a5bab06c680-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-a2003ac5-667f-4db2-9e00-e06f773197fa" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-a2003ac5-667f-4db2-9e00-e06f773197fa" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-92ba88ac-eb74-4217-aee4-2a5bab06c680" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:24 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-92ba88ac-eb74-4217-aee4-2a5bab06c680" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] Deleting offline snapshot 92ba88ac-eb74-4217-aee4-2a5bab06c680 of volume a2003ac5-667f-4db2-9e00-e06f773197fa {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:12:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] snapshot_file for this snap is: volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:12:24 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[33225ce5-2159-46c4-9f9a-904d59fdc6f1]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:25 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680 Jul 06 21:12:25 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:25 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680" returned: 0 in 0.718s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:25 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2003ac5-667f-4db2-9e00-e06f773197fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:12:25 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6798b6b0-0d9f-4513-88ca-be5446395cfc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:25 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa Jul 06 21:12:25 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:26 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa" returned: 0 in 0.731s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:26 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680 Jul 06 21:12:26 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:27 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680" returned: 0 in 0.719s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:27 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680 Jul 06 21:12:27 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:27 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa.92ba88ac-eb74-4217-aee4-2a5bab06c680" returned: 0 in 0.622s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-92ba88ac-eb74-4217-aee4-2a5bab06c680" released by "_delete_snapshot" :: held 2.873s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-a2003ac5-667f-4db2-9e00-e06f773197fa" released by "delete_snapshot" :: held 2.894s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:27 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] Created reservations ['a36f9606-cc3b-4f67-9bd3-95a19909bc11', 'd0c0b10e-2a79-4a9c-aea5-44f660228f35', 'c8e570b2-fd87-48d2-ac4f-19421d80f6f1', 'f162609c-63ff-4311-ae70-89ed3a1707b9'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:12:27 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] Delete snapshot completed successfully. Jul 06 21:12:27 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-29186af9-db59-41a5-9ec2-f32c738f2481 tempest-ProjectMemberTests-464659054 None] Lock "cinder-92ba88ac-eb74-4217-aee4-2a5bab06c680-delete_snapshot" released by "delete_snapshot" :: held 3.023s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:28 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-a2003ac5-667f-4db2-9e00-e06f773197fa-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:28 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] Lock "cinder-a2003ac5-667f-4db2-9e00-e06f773197fa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:28 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-a2003ac5-667f-4db2-9e00-e06f773197fa" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:28 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-a2003ac5-667f-4db2-9e00-e06f773197fa" acquired by "delete_volume" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:28 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[df655a26-5094-43a9-92d8-82e11c434e2b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:28 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa Jul 06 21:12:28 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:28 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa" returned: 0 in 0.725s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:28 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa Jul 06 21:12:28 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:29 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-a2003ac5-667f-4db2-9e00-e06f773197fa" returned: 0 in 0.617s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:29 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-a2003ac5-667f-4db2-9e00-e06f773197fa" released by "delete_volume" :: held 1.393s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:29 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] Created reservations ['358ea553-2150-4379-864f-09b63571c3ca', '202518ab-6c19-479d-a94b-05720c256132', 'd0ef8205-4324-45c2-b38f-4733c21636e2', '95ad2c6a-6488-405d-98ba-58c48fbc4411'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:12:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:29 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:29 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:29 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:12:29 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:30 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.629s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:12:30 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] Deleted volume successfully. Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-85561c71-9658-4eaa-bec4-ae89f628811b tempest-ProjectMemberTests-464659054 None] Lock "cinder-a2003ac5-667f-4db2-9e00-e06f773197fa-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Flow 'volume_create_manager' (6dff1262-a3cc-4154-85b9-bb64fdc5aecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae214c0f-6a62-473c-9431-9676d53e9341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae214c0f-6a62-473c-9431-9676d53e9341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1390707424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd40d1b-569d-4720-9179-3977be0b552b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf91a4684da044db85c6285e8ceb955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:31Z,use_quota=True,user_id='193f18baf5d94bb9a2b8367616b42f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b4c64a-44f6-4a6a-91ad-6e9a1e93ef23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b4c64a-44f6-4a6a-91ad-6e9a1e93ef23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b6f3290-1186-4203-b3f5-592242957d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b6f3290-1186-4203-b3f5-592242957d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbd40d1b-569d-4720-9179-3977be0b552b', 'volume_name': 'volume-dbd40d1b-569d-4720-9179-3977be0b552b', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8e58d3-f837-4aa2-af39-7f7ef63baad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8e58d3-f837-4aa2-af39-7f7ef63baad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38794e63-6824-4cc2-bb45-2b450e667b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:30 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Volume dbd40d1b-569d-4720-9179-3977be0b552b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbd40d1b-569d-4720-9179-3977be0b552b', 'volume_size': 1} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1390707424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd40d1b-569d-4720-9179-3977be0b552b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf91a4684da044db85c6285e8ceb955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:31Z,use_quota=True,user_id='193f18baf5d94bb9a2b8367616b42f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Creating volume dbd40d1b-569d-4720-9179-3977be0b552b {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:12:30 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:12:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:30 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b 1073741824 Jul 06 21:12:30 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:31 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b 1073741824" returned: 0 in 0.785s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:31 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b Jul 06 21:12:31 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:32 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b" returned: 0 in 0.612s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:32 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:12:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:32 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38794e63-6824-4cc2-bb45-2b450e667b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbd40d1b-569d-4720-9179-3977be0b552b', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:32 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff2d96a-7c04-4bfe-b3be-4f41977b7a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:32 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Volume volume-dbd40d1b-569d-4720-9179-3977be0b552b (dbd40d1b-569d-4720-9179-3977be0b552b): created successfully Jul 06 21:12:32 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff2d96a-7c04-4bfe-b3be-4f41977b7a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:32 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Flow 'volume_create_manager' (6dff1262-a3cc-4154-85b9-bb64fdc5aecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:12:32 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-6df21e05-bbff-43fc-991b-a417cfa9ecd3 tempest-ProjectMemberTests-464659054 None] Created volume successfully. Jul 06 21:12:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:32 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] Creating offline snapshot 4862709f-f538-427a-8190-5f54448b4cb5 of volume dbd40d1b-569d-4720-9179-3977be0b552b {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:12:32 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4842e203-6d00-494f-a9bd-74afaafd80d8]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:33 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b Jul 06 21:12:33 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:33 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b" returned: 0 in 0.717s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:33 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5 1G Jul 06 21:12:33 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:34 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5 1G" returned: 0 in 0.746s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbd40d1b-569d-4720-9179-3977be0b552b -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:34 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbd40d1b-569d-4720-9179-3977be0b552b -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5 Jul 06 21:12:34 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:35 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbd40d1b-569d-4720-9179-3977be0b552b -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5" returned: 0 in 0.658s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:35 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5 is being set with open permissions: ugo+rw Jul 06 21:12:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:35 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5 Jul 06 21:12:35 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:35 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5" returned: 0 in 0.617s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:35 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.info Jul 06 21:12:35 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:36 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.info" returned: 0 in 0.618s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:36 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.info is being set with open permissions: ugo+rw Jul 06 21:12:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:36 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.info Jul 06 21:12:36 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:36 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.info" returned: 0 in 0.641s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.075s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:37 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-7b603db2-b42f-4f46-9b2f-133615e59669 tempest-ProjectMemberTests-464659054 None] Create snapshot completed successfully Jul 06 21:12:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-4862709f-f538-427a-8190-5f54448b4cb5-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] Lock "cinder-4862709f-f538-427a-8190-5f54448b4cb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-dbd40d1b-569d-4720-9179-3977be0b552b" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-dbd40d1b-569d-4720-9179-3977be0b552b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-4862709f-f538-427a-8190-5f54448b4cb5" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-4862709f-f538-427a-8190-5f54448b4cb5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] Deleting offline snapshot 4862709f-f538-427a-8190-5f54448b4cb5 of volume dbd40d1b-569d-4720-9179-3977be0b552b {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:12:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] snapshot_file for this snap is: volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:12:38 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5a296f-a019-4156-b9d1-8abec6095420]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:38 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5 Jul 06 21:12:38 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:38 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5" returned: 0 in 0.741s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:38 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbd40d1b-569d-4720-9179-3977be0b552b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:12:39 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b25c95-118a-4a7a-b5ca-73e2f564243d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:39 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b Jul 06 21:12:39 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:39 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b" returned: 0 in 0.762s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:39 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5 Jul 06 21:12:39 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:40 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5" returned: 0 in 0.701s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:40 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5 Jul 06 21:12:40 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:41 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b.4862709f-f538-427a-8190-5f54448b4cb5" returned: 0 in 0.610s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:41 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-4862709f-f538-427a-8190-5f54448b4cb5" released by "_delete_snapshot" :: held 2.902s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:41 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-dbd40d1b-569d-4720-9179-3977be0b552b" released by "delete_snapshot" :: held 2.923s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:41 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=77,cinder:INSERT=24,cinder:UPDATE=95,cinder:DELETE=6 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:12:41 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=70,cinder:INSERT=29,cinder:UPDATE=93,cinder:DELETE=9 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:12:41 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] Created reservations ['0a71ec81-bf6e-43ac-992e-52cfd92a8642', '8d2cf693-6105-4933-bfaf-473a7a4ba3cf', 'afc464ee-7884-4075-bd44-c1be01116120', '819c3737-5ef8-43f8-8f5c-8fab06ad2f99'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:12:41 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] Delete snapshot completed successfully. Jul 06 21:12:41 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-09f04ec4-fc3d-4ebf-9b29-86e9bfed9c5c tempest-ProjectMemberTests-464659054 None] Lock "cinder-4862709f-f538-427a-8190-5f54448b4cb5-delete_snapshot" released by "delete_snapshot" :: held 3.061s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:41 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-dbd40d1b-569d-4720-9179-3977be0b552b-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:41 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] Lock "cinder-dbd40d1b-569d-4720-9179-3977be0b552b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:41 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-dbd40d1b-569d-4720-9179-3977be0b552b" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:41 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-dbd40d1b-569d-4720-9179-3977be0b552b" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:41 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1321ef-143e-4684-b9ff-3a3b3eefd138]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:41 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b Jul 06 21:12:41 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:42 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b" returned: 0 in 0.729s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:42 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b Jul 06 21:12:42 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:42 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-dbd40d1b-569d-4720-9179-3977be0b552b" returned: 0 in 0.612s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-dbd40d1b-569d-4720-9179-3977be0b552b" released by "delete_volume" :: held 1.401s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:42 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] Created reservations ['d8b3fd17-1dd6-40d2-a06b-6cbf10260817', 'a57e8feb-a8f6-4985-8011-5a81f7bbe3d4', '15b2b2ae-0803-4409-af97-a48ffc92fd55', '4cbeffc2-3f13-4dad-87b1-19b908e815c4'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:12:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:42 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:12:42 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:43 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.704s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:43 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:12:43 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] Deleted volume successfully. Jul 06 21:12:43 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-cf9b4b11-d4f8-4d83-91d7-352690972121 tempest-ProjectMemberTests-464659054 None] Lock "cinder-dbd40d1b-569d-4720-9179-3977be0b552b-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:43 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:12:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Flow 'volume_create_manager' (dcfa6dfd-5737-4454-b61b-0ed24dfba499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:12:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38d0109-44d9-4013-9d92-957498b866fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38d0109-44d9-4013-9d92-957498b866fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-332958138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba32f38-c44c-49af-8667-e5b258268a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf91a4684da044db85c6285e8ceb955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:44Z,use_quota=True,user_id='193f18baf5d94bb9a2b8367616b42f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0781e8e-d542-4672-a6fa-4de87f4222ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0781e8e-d542-4672-a6fa-4de87f4222ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2fffaa-9fb7-415f-bbad-9dcf11be2efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2fffaa-9fb7-415f-bbad-9dcf11be2efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fba32f38-c44c-49af-8667-e5b258268a45', 'volume_name': 'volume-fba32f38-c44c-49af-8667-e5b258268a45', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62202717-c67b-4351-b721-c472993cf589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62202717-c67b-4351-b721-c472993cf589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820f65ec-1d29-443e-aed2-b33b393f3b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:44 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Volume fba32f38-c44c-49af-8667-e5b258268a45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fba32f38-c44c-49af-8667-e5b258268a45', 'volume_size': 1} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-332958138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba32f38-c44c-49af-8667-e5b258268a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf91a4684da044db85c6285e8ceb955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:44Z,use_quota=True,user_id='193f18baf5d94bb9a2b8367616b42f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Creating volume fba32f38-c44c-49af-8667-e5b258268a45 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:12:44 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:44 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45 1073741824 Jul 06 21:12:44 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:44 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45 1073741824" returned: 0 in 0.771s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:44 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45 Jul 06 21:12:44 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:45 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45" returned: 0 in 0.607s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:12:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820f65ec-1d29-443e-aed2-b33b393f3b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba32f38-c44c-49af-8667-e5b258268a45', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3768dc0c-9584-4cf5-b2f6-e3900adf7f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:45 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Volume volume-fba32f38-c44c-49af-8667-e5b258268a45 (fba32f38-c44c-49af-8667-e5b258268a45): created successfully Jul 06 21:12:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3768dc0c-9584-4cf5-b2f6-e3900adf7f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Flow 'volume_create_manager' (dcfa6dfd-5737-4454-b61b-0ed24dfba499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:12:45 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-5a1421e9-2a39-41c4-9c98-87321bd92001 tempest-ProjectMemberTests-464659054 None] Created volume successfully. Jul 06 21:12:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] Creating offline snapshot 1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2 of volume fba32f38-c44c-49af-8667-e5b258268a45 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:12:46 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d416eba1-278e-4c43-be13-fd986ce20f36]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:46 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45 Jul 06 21:12:46 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:46 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45" returned: 0 in 0.718s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:46 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2 1G Jul 06 21:12:46 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:47 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2 1G" returned: 0 in 0.849s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fba32f38-c44c-49af-8667-e5b258268a45 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:47 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fba32f38-c44c-49af-8667-e5b258268a45 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2 Jul 06 21:12:47 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:48 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fba32f38-c44c-49af-8667-e5b258268a45 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2" returned: 0 in 0.725s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:48 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2 is being set with open permissions: ugo+rw Jul 06 21:12:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:48 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2 Jul 06 21:12:48 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:49 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2" returned: 0 in 0.692s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:49 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.info Jul 06 21:12:49 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:49 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.info" returned: 0 in 0.633s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:49 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.info is being set with open permissions: ugo+rw Jul 06 21:12:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:49 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.info Jul 06 21:12:49 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:50 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.info" returned: 0 in 0.626s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.322s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:50 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f862d1a9-3ed5-40ec-a726-43c39c1adf0a tempest-ProjectMemberTests-464659054 None] Create snapshot completed successfully Jul 06 21:12:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] Lock "cinder-1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-fba32f38-c44c-49af-8667-e5b258268a45" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-fba32f38-c44c-49af-8667-e5b258268a45" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] Deleting offline snapshot 1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2 of volume fba32f38-c44c-49af-8667-e5b258268a45 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:12:51 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] snapshot_file for this snap is: volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:12:51 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7ed4ac-7f73-439d-8d53-717b43e2dce8]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:51 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2 Jul 06 21:12:51 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:52 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2" returned: 0 in 0.735s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fba32f38-c44c-49af-8667-e5b258268a45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:12:52 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5064735f-cb98-4782-8448-5dc9ba4a62af]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:52 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45 Jul 06 21:12:52 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:53 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45" returned: 0 in 0.827s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:53 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2 Jul 06 21:12:53 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:53 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2" returned: 0 in 0.766s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:53 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2 Jul 06 21:12:53 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:54 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45.1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2" returned: 0 in 0.616s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2" released by "_delete_snapshot" :: held 3.034s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-fba32f38-c44c-49af-8667-e5b258268a45" released by "delete_snapshot" :: held 3.060s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:54 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] Created reservations ['c2d6256f-f0a7-4b1a-b439-0b505e6c8865', '01826205-8c6d-46bb-98b8-6af1d0a1b691', 'df9567be-794d-4239-9ed9-8f4010f6dea7', '0a65c4fa-eec7-4f74-a8a0-0a315399c39b'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:12:54 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] Delete snapshot completed successfully. Jul 06 21:12:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-eaec3542-4606-4d96-b919-7f97fe345fa2 tempest-ProjectMemberTests-464659054 None] Lock "cinder-1d15d7dc-6d0c-47ac-9ed0-f38eeeaac2a2-delete_snapshot" released by "delete_snapshot" :: held 3.192s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-fba32f38-c44c-49af-8667-e5b258268a45-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] Lock "cinder-fba32f38-c44c-49af-8667-e5b258268a45-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-fba32f38-c44c-49af-8667-e5b258268a45" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-fba32f38-c44c-49af-8667-e5b258268a45" acquired by "delete_volume" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:55 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df39ecc-56a4-46e8-93e7-5493f4ee146e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:55 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45 Jul 06 21:12:55 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:56 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45" returned: 0 in 0.725s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:56 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45 Jul 06 21:12:56 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:57 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-fba32f38-c44c-49af-8667-e5b258268a45" returned: 0 in 0.656s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-fba32f38-c44c-49af-8667-e5b258268a45" released by "delete_volume" :: held 1.438s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:57 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] Created reservations ['ade806d9-8fef-487b-8169-381f695b96b7', 'fbe76156-4c49-4632-9fb2-67b493e813d8', '8ed8bb11-f527-4c09-b096-6ccce254cdce', '33474e09-c564-472f-a570-bbc53c4f690a'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:12:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:57 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:12:57 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:57 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.666s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:57 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:12:57 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] Deleted volume successfully. Jul 06 21:12:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-8139c3af-c46a-4677-9bee-36b91ed845da tempest-ProjectMemberTests-464659054 None] Lock "cinder-fba32f38-c44c-49af-8667-e5b258268a45-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:58 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:12:58 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Flow 'volume_create_manager' (a982b4b7-366c-4ee8-bb73-7a78196ca1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f6b942-bd58-49e1-b37e-58cb00c10c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f6b942-bd58-49e1-b37e-58cb00c10c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1982599843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c473c167-e45b-4629-a4d7-c5d9b8078e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf91a4684da044db85c6285e8ceb955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:58Z,use_quota=True,user_id='193f18baf5d94bb9a2b8367616b42f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aededee4-8979-4545-8d5e-c50ff3460f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aededee4-8979-4545-8d5e-c50ff3460f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e3207d-b708-4f73-9a83-be20f415f8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e3207d-b708-4f73-9a83-be20f415f8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c473c167-e45b-4629-a4d7-c5d9b8078e02', 'volume_name': 'volume-c473c167-e45b-4629-a4d7-c5d9b8078e02', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf1e2d5-a50a-43b7-9d8f-f2fa0e69ed12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf1e2d5-a50a-43b7-9d8f-f2fa0e69ed12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263d2465-0996-47ad-946e-25403265ab07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:58 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Volume c473c167-e45b-4629-a4d7-c5d9b8078e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c473c167-e45b-4629-a4d7-c5d9b8078e02', 'volume_size': 1} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1982599843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c473c167-e45b-4629-a4d7-c5d9b8078e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf91a4684da044db85c6285e8ceb955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:58Z,use_quota=True,user_id='193f18baf5d94bb9a2b8367616b42f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Creating volume c473c167-e45b-4629-a4d7-c5d9b8078e02 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:12:58 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:58 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02 1073741824 Jul 06 21:12:58 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:58 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.683s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 29 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:12:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:12:59 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02 1073741824" returned: 0 in 0.776s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:59 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02 Jul 06 21:12:59 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:59 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02" returned: 0 in 0.610s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:12:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263d2465-0996-47ad-946e-25403265ab07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c473c167-e45b-4629-a4d7-c5d9b8078e02', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c712ced-80d8-4c86-9236-e9d5f74dde2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:59 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Volume volume-c473c167-e45b-4629-a4d7-c5d9b8078e02 (c473c167-e45b-4629-a4d7-c5d9b8078e02): created successfully Jul 06 21:12:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c712ced-80d8-4c86-9236-e9d5f74dde2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Flow 'volume_create_manager' (a982b4b7-366c-4ee8-bb73-7a78196ca1c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:12:59 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-4cd781a2-83ce-4ead-bc94-a7f0d830dc95 tempest-ProjectMemberTests-464659054 None] Created volume successfully. Jul 06 21:13:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:00 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] Creating offline snapshot 0a30a6ec-d757-4a8a-9e68-a44cbd95de37 of volume c473c167-e45b-4629-a4d7-c5d9b8078e02 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:13:00 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c55976-752d-4aab-b600-1c9c1a954fe6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:00 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02 Jul 06 21:13:00 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:01 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02" returned: 0 in 0.753s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:01 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37 1G Jul 06 21:13:01 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:02 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37 1G" returned: 0 in 0.905s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c473c167-e45b-4629-a4d7-c5d9b8078e02 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:02 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c473c167-e45b-4629-a4d7-c5d9b8078e02 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37 Jul 06 21:13:02 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:02 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c473c167-e45b-4629-a4d7-c5d9b8078e02 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37" returned: 0 in 0.773s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:02 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37 is being set with open permissions: ugo+rw Jul 06 21:13:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:03 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37 Jul 06 21:13:03 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:03 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37" returned: 0 in 0.611s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:03 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.info Jul 06 21:13:03 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:04 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.info" returned: 0 in 0.637s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:04 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.info is being set with open permissions: ugo+rw Jul 06 21:13:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:04 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.info Jul 06 21:13:04 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:04 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.info" returned: 0 in 0.623s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.383s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:04 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-b4e6fd9c-0468-475c-abdb-7c44fbe11d34 tempest-ProjectMemberTests-464659054 None] Create snapshot completed successfully Jul 06 21:13:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-0a30a6ec-d757-4a8a-9e68-a44cbd95de37-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] Lock "cinder-0a30a6ec-d757-4a8a-9e68-a44cbd95de37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-c473c167-e45b-4629-a4d7-c5d9b8078e02" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-c473c167-e45b-4629-a4d7-c5d9b8078e02" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-0a30a6ec-d757-4a8a-9e68-a44cbd95de37" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-0a30a6ec-d757-4a8a-9e68-a44cbd95de37" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] Deleting offline snapshot 0a30a6ec-d757-4a8a-9e68-a44cbd95de37 of volume c473c167-e45b-4629-a4d7-c5d9b8078e02 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:13:05 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] snapshot_file for this snap is: volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:13:05 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4960a7-8307-463b-b6f5-11774fb743ee]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:06 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37 Jul 06 21:13:06 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:06 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37" returned: 0 in 0.736s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c473c167-e45b-4629-a4d7-c5d9b8078e02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:13:06 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6047f4df-0a4d-4e75-be0d-67a337c07299]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:06 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02 Jul 06 21:13:06 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:07 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02" returned: 0 in 0.779s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:07 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37 Jul 06 21:13:07 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:08 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37" returned: 0 in 0.702s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:08 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37 Jul 06 21:13:08 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:08 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02.0a30a6ec-d757-4a8a-9e68-a44cbd95de37" returned: 0 in 0.735s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-0a30a6ec-d757-4a8a-9e68-a44cbd95de37" released by "_delete_snapshot" :: held 3.042s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:08 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-c473c167-e45b-4629-a4d7-c5d9b8078e02" released by "delete_snapshot" :: held 3.069s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:09 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] Created reservations ['754ca4bd-b1e0-4dbb-93f2-0d1774ef4186', 'd178de7b-7972-4500-afaf-a0774ac8b724', '61608b0a-19c0-4e61-831e-afcecee9daa5', '0b4ae58d-d184-401f-85fa-5ed499d19818'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:13:09 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] Delete snapshot completed successfully. Jul 06 21:13:09 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5856eed-f217-47ef-8dac-7f450cf61bf9 tempest-ProjectMemberTests-464659054 None] Lock "cinder-0a30a6ec-d757-4a8a-9e68-a44cbd95de37-delete_snapshot" released by "delete_snapshot" :: held 3.210s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-c473c167-e45b-4629-a4d7-c5d9b8078e02-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] Lock "cinder-c473c167-e45b-4629-a4d7-c5d9b8078e02-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] Acquiring lock "cinder-quobyte-c473c167-e45b-4629-a4d7-c5d9b8078e02" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:10 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-c473c167-e45b-4629-a4d7-c5d9b8078e02" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:10 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[239baa69-d0b5-42dd-9d1e-141edfc197a6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:10 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02 Jul 06 21:13:10 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:10 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02" returned: 0 in 0.797s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:11 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02 Jul 06 21:13:11 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:11 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c473c167-e45b-4629-a4d7-c5d9b8078e02" returned: 0 in 0.711s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:11 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] Lock "cinder-quobyte-c473c167-e45b-4629-a4d7-c5d9b8078e02" released by "delete_volume" :: held 1.570s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:11 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] Created reservations ['6b078885-e1ee-4fa8-a25a-5d5f7fd6524a', '945c03d1-47e0-4d50-a8a1-5e49c83ec444', '423c8f96-c474-4ee2-aef0-2a933a64c21b', 'a568ac3c-43c5-416f-a5ed-bf6560b8f066'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:13:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:11 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:11 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:13:11 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:12 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.672s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:12 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:13:12 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] Deleted volume successfully. Jul 06 21:13:12 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-71c1feb9-e9a0-46b2-b43d-e29a4f86358b tempest-ProjectMemberTests-464659054 None] Lock "cinder-c473c167-e45b-4629-a4d7-c5d9b8078e02-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Flow 'volume_create_manager' (e009d3b3-fa35-496a-96ae-6ac2b5062d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e13f0f9-0632-41d9-bbf5-bd1bc8abfc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e13f0f9-0632-41d9-bbf5-bd1bc8abfc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575011342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b57059-2901-4cca-8aa3-769e9c56cd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b5a57c502043b181b88e5e69c037df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:16Z,use_quota=True,user_id='eef8550ba73d442cb6cb9e7fc1b1aa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74b4580-18a9-45de-9b74-0488d4a6433e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74b4580-18a9-45de-9b74-0488d4a6433e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16bd0420-c987-4cda-8230-3eddf34e789a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16bd0420-c987-4cda-8230-3eddf34e789a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9b57059-2901-4cca-8aa3-769e9c56cd88', 'volume_name': 'volume-b9b57059-2901-4cca-8aa3-769e9c56cd88', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24de51cf-d5c7-49a2-95ee-fc3545f09586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24de51cf-d5c7-49a2-95ee-fc3545f09586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c660aa-7fee-4077-a7a7-7e2ee24a3b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:15 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Volume b9b57059-2901-4cca-8aa3-769e9c56cd88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9b57059-2901-4cca-8aa3-769e9c56cd88', 'volume_size': 1} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575011342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b57059-2901-4cca-8aa3-769e9c56cd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b5a57c502043b181b88e5e69c037df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:16Z,use_quota=True,user_id='eef8550ba73d442cb6cb9e7fc1b1aa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Creating volume b9b57059-2901-4cca-8aa3-769e9c56cd88 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:13:15 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:13:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:16 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88 1073741824 Jul 06 21:13:16 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:16 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88 1073741824" returned: 0 in 0.869s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:16 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88 Jul 06 21:13:16 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:17 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88" returned: 0 in 0.646s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:17 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:13:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c660aa-7fee-4077-a7a7-7e2ee24a3b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9b57059-2901-4cca-8aa3-769e9c56cd88', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc83ed1d-5efb-43df-9175-fdac3a679b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:17 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Volume volume-b9b57059-2901-4cca-8aa3-769e9c56cd88 (b9b57059-2901-4cca-8aa3-769e9c56cd88): created successfully Jul 06 21:13:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc83ed1d-5efb-43df-9175-fdac3a679b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:17 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Flow 'volume_create_manager' (e009d3b3-fa35-496a-96ae-6ac2b5062d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:17 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-7f22daed-3e50-4af7-a4d1-e2857860e773 tempest-ProjectReaderTests-2066788325 None] Created volume successfully. Jul 06 21:13:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:18 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] Creating offline snapshot e732d5ac-b0cf-46d6-8806-cd72848579a4 of volume b9b57059-2901-4cca-8aa3-769e9c56cd88 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:13:18 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe5b5c7-053d-41a9-9987-74ac7f217026]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:18 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88 Jul 06 21:13:18 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:18 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88" returned: 0 in 0.775s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:18 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4 1G Jul 06 21:13:18 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:19 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4 1G" returned: 0 in 0.813s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9b57059-2901-4cca-8aa3-769e9c56cd88 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:19 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9b57059-2901-4cca-8aa3-769e9c56cd88 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4 Jul 06 21:13:19 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:20 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9b57059-2901-4cca-8aa3-769e9c56cd88 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4" returned: 0 in 0.701s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:20 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4 is being set with open permissions: ugo+rw Jul 06 21:13:20 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:20 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4 Jul 06 21:13:20 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:21 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4" returned: 0 in 0.630s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:21 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.info Jul 06 21:13:21 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:21 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.info" returned: 0 in 0.682s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:21 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.info is being set with open permissions: ugo+rw Jul 06 21:13:21 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:21 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.info Jul 06 21:13:21 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:22 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.info" returned: 0 in 0.623s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:22 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.300s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:22 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-6d1c621e-165b-4df5-af15-88d39add1d23 tempest-ProjectReaderTests-2066788325 None] Create snapshot completed successfully Jul 06 21:13:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-e732d5ac-b0cf-46d6-8806-cd72848579a4-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-e732d5ac-b0cf-46d6-8806-cd72848579a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-quobyte-b9b57059-2901-4cca-8aa3-769e9c56cd88" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-b9b57059-2901-4cca-8aa3-769e9c56cd88" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-quobyte-e732d5ac-b0cf-46d6-8806-cd72848579a4" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:23 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-e732d5ac-b0cf-46d6-8806-cd72848579a4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] Deleting offline snapshot e732d5ac-b0cf-46d6-8806-cd72848579a4 of volume b9b57059-2901-4cca-8aa3-769e9c56cd88 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:13:23 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] snapshot_file for this snap is: volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:13:23 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7faeb9e-995a-4ef2-84ab-9378cbbfc3de]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:23 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:23 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4 Jul 06 21:13:23 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:24 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4" returned: 0 in 0.779s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:24 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9b57059-2901-4cca-8aa3-769e9c56cd88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:13:24 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[edecb54d-f085-4957-9748-e751536beffb]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:24 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:24 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88 Jul 06 21:13:24 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:25 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88" returned: 0 in 0.726s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:25 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4 Jul 06 21:13:25 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:25 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4" returned: 0 in 0.745s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:25 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:25 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4 Jul 06 21:13:25 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:26 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88.e732d5ac-b0cf-46d6-8806-cd72848579a4" returned: 0 in 0.606s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:26 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-e732d5ac-b0cf-46d6-8806-cd72848579a4" released by "_delete_snapshot" :: held 2.940s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:26 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-b9b57059-2901-4cca-8aa3-769e9c56cd88" released by "delete_snapshot" :: held 2.963s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:26 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] Created reservations ['327e3625-2a2e-441f-9447-836403ae2677', 'acf7b110-43af-4cd0-9837-b1fb4ba03dab', 'fdd1143c-da3b-4757-8b83-4db5b1bf1d4d', 'bfeecd17-3154-4f92-bf0d-89440ab5c6b3'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:13:26 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] Delete snapshot completed successfully. Jul 06 21:13:26 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-dc4f3bed-150d-4a05-b2a3-a2d4e27f2681 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-e732d5ac-b0cf-46d6-8806-cd72848579a4-delete_snapshot" released by "delete_snapshot" :: held 3.093s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:26 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-b9b57059-2901-4cca-8aa3-769e9c56cd88-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:26 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-b9b57059-2901-4cca-8aa3-769e9c56cd88-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:26 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-quobyte-b9b57059-2901-4cca-8aa3-769e9c56cd88" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:26 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-b9b57059-2901-4cca-8aa3-769e9c56cd88" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:26 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d00694-c60a-4421-aa2f-06a79003c79b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:26 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:26 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88 Jul 06 21:13:26 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:27 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88" returned: 0 in 0.764s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:27 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:27 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88 Jul 06 21:13:27 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:28 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-b9b57059-2901-4cca-8aa3-769e9c56cd88" returned: 0 in 0.618s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:28 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-b9b57059-2901-4cca-8aa3-769e9c56cd88" released by "delete_volume" :: held 1.435s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:28 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] Created reservations ['d6a40c64-bff0-4867-a625-7bc734186a44', '44bc61d4-9e1b-40df-8069-897ad594934d', '4dd47524-aa6a-4683-bd3c-a7cfebcbbd3a', '035f1628-4741-442b-88d2-070bab0a0740'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:13:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:28 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:28 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:28 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:13:28 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:28 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:28 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.697s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:28 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:13:28 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] Deleted volume successfully. Jul 06 21:13:28 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2694a89b-7660-419e-8d3f-37371a1adcb1 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-b9b57059-2901-4cca-8aa3-769e9c56cd88-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Flow 'volume_create_manager' (96d71409-1522-48db-b563-905bcc4c0569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8c6834-68ea-47d8-aeb1-0a02e4066d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8c6834-68ea-47d8-aeb1-0a02e4066d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-471459192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6611e37-28d3-4a1e-b94b-2caf6e5e5c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b5a57c502043b181b88e5e69c037df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:29Z,use_quota=True,user_id='eef8550ba73d442cb6cb9e7fc1b1aa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88dadf5-e1ae-41e5-912b-da81c5d2c56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88dadf5-e1ae-41e5-912b-da81c5d2c56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4a938e-acce-4db2-9671-ed6d681f8fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4a938e-acce-4db2-9671-ed6d681f8fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6611e37-28d3-4a1e-b94b-2caf6e5e5c04', 'volume_name': 'volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7bb02d3-3306-4b74-8b0f-72acf5be9264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7bb02d3-3306-4b74-8b0f-72acf5be9264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4335535a-49d0-4b21-9a95-e35659fdc477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:29 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Volume e6611e37-28d3-4a1e-b94b-2caf6e5e5c04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04', 'volume_size': 1} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-471459192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6611e37-28d3-4a1e-b94b-2caf6e5e5c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b5a57c502043b181b88e5e69c037df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:29Z,use_quota=True,user_id='eef8550ba73d442cb6cb9e7fc1b1aa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Creating volume e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:13:29 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:13:29 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:29 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 1073741824 Jul 06 21:13:29 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:30 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 1073741824" returned: 0 in 0.818s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:30 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 Jul 06 21:13:30 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:30 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04" returned: 0 in 0.657s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:30 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:13:30 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4335535a-49d0-4b21-9a95-e35659fdc477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7451f9-cb4a-42e4-a19e-4dcd3c6772d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:30 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Volume volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 (e6611e37-28d3-4a1e-b94b-2caf6e5e5c04): created successfully Jul 06 21:13:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7451f9-cb4a-42e4-a19e-4dcd3c6772d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:30 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Flow 'volume_create_manager' (96d71409-1522-48db-b563-905bcc4c0569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:30 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-8d1837d1-c0bf-42d2-beb1-d1b95b8c1598 tempest-ProjectReaderTests-2066788325 None] Created volume successfully. Jul 06 21:13:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] Creating offline snapshot 15cb29e2-40dd-4d3e-918e-2aff0502e221 of volume e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:13:31 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dd15e8-3b5a-4ee8-b20f-fcbca243474c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:31 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 Jul 06 21:13:31 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:32 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04" returned: 0 in 0.798s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:32 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221 1G Jul 06 21:13:32 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:33 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221 1G" returned: 0 in 0.791s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:33 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221 Jul 06 21:13:33 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:33 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221" returned: 0 in 0.759s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:33 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221 is being set with open permissions: ugo+rw Jul 06 21:13:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:33 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221 Jul 06 21:13:33 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:34 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221" returned: 0 in 0.668s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:34 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.info Jul 06 21:13:34 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:35 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.info" returned: 0 in 0.632s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:35 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.info is being set with open permissions: ugo+rw Jul 06 21:13:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:35 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.info Jul 06 21:13:35 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:35 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.info" returned: 0 in 0.641s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.400s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:35 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-91771fb4-9aca-44a9-b49c-6b861b88d207 tempest-ProjectReaderTests-2066788325 None] Create snapshot completed successfully Jul 06 21:13:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-15cb29e2-40dd-4d3e-918e-2aff0502e221-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-15cb29e2-40dd-4d3e-918e-2aff0502e221-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-quobyte-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-quobyte-15cb29e2-40dd-4d3e-918e-2aff0502e221" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:36 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-15cb29e2-40dd-4d3e-918e-2aff0502e221" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:36 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] Deleting offline snapshot 15cb29e2-40dd-4d3e-918e-2aff0502e221 of volume e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:13:36 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] snapshot_file for this snap is: volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:13:36 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9f1247-73ea-43fb-8aae-69f3e3efa143]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:36 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221 Jul 06 21:13:36 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:37 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221" returned: 0 in 0.746s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:37 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:13:37 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9a7904-5224-44d2-9cc0-0c9afe5b85a1]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:37 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 Jul 06 21:13:37 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:38 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04" returned: 0 in 0.739s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:38 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221 Jul 06 21:13:38 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:39 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221" returned: 0 in 0.697s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:39 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221 Jul 06 21:13:39 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:39 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04.15cb29e2-40dd-4d3e-918e-2aff0502e221" returned: 0 in 0.630s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-15cb29e2-40dd-4d3e-918e-2aff0502e221" released by "_delete_snapshot" :: held 2.899s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04" released by "delete_snapshot" :: held 2.922s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:39 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] Created reservations ['168e54d9-3803-4002-9b8a-c31a7ff37da6', 'c385afdf-4da0-4e5a-b755-6ea62462983c', 'b1182520-115b-420a-ad54-dff51bc16d8f', '1185f2bb-cac5-4050-9593-b0b99aa6b31b'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:13:39 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] Delete snapshot completed successfully. Jul 06 21:13:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3998bd39-17b9-4464-bed0-fb69c0dcabe1 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-15cb29e2-40dd-4d3e-918e-2aff0502e221-delete_snapshot" released by "delete_snapshot" :: held 3.058s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] Lock "cinder-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-quobyte-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04" acquired by "delete_volume" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:40 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45fc045-1562-4177-a162-9213a4f50b46]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:40 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 Jul 06 21:13:40 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:40 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04" returned: 0 in 0.753s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:40 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04 Jul 06 21:13:40 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:41 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04" returned: 0 in 0.637s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:41 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04" released by "delete_volume" :: held 1.450s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:41 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:INSERT=21,cinder:UPDATE=86,cinder:SELECT=50,cinder:DELETE=9 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:13:41 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=74,cinder:INSERT=23,cinder:UPDATE=71,cinder:DELETE=3 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:13:41 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] Created reservations ['923c8178-5aea-4b0e-bb63-2bc98fd42644', '4ffefa99-fdcb-468f-b713-b0b0a963f75c', '62b48e7e-ee30-4a64-ab40-1a559aa2b826', '22e7a830-ff85-4ca7-b436-41cf3f882329'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:13:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:41 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:41 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:41 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:13:41 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:42 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.662s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:13:42 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] Deleted volume successfully. Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-2c1a1ac0-d53e-48c9-a3c0-89cd321891ad tempest-ProjectReaderTests-2066788325 None] Lock "cinder-e6611e37-28d3-4a1e-b94b-2caf6e5e5c04-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Flow 'volume_create_manager' (c84efcf1-af60-45c8-8f6e-dad2f49f56c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a62c92-6a24-40aa-b9b9-9c816b11b48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a62c92-6a24-40aa-b9b9-9c816b11b48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-138817992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebe6c8c-4fd2-44f4-b727-881e78a516dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b5a57c502043b181b88e5e69c037df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:43Z,use_quota=True,user_id='eef8550ba73d442cb6cb9e7fc1b1aa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ecc084d-8791-4fa0-9a08-2300de47cdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ecc084d-8791-4fa0-9a08-2300de47cdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ebb388c-a942-460a-981a-94947d2ca71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ebb388c-a942-460a-981a-94947d2ca71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cebe6c8c-4fd2-44f4-b727-881e78a516dc', 'volume_name': 'volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d341337d-092d-4405-b5fe-a4d699dc6435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d341337d-092d-4405-b5fe-a4d699dc6435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4bb98d-04bb-456f-8aad-ab83a5eaa955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:42 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Volume cebe6c8c-4fd2-44f4-b727-881e78a516dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc', 'volume_size': 1} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-138817992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebe6c8c-4fd2-44f4-b727-881e78a516dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b5a57c502043b181b88e5e69c037df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:43Z,use_quota=True,user_id='eef8550ba73d442cb6cb9e7fc1b1aa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Creating volume cebe6c8c-4fd2-44f4-b727-881e78a516dc {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:13:42 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:13:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:42 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc 1073741824 Jul 06 21:13:42 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:43 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc 1073741824" returned: 0 in 0.784s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:43 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc Jul 06 21:13:43 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:44 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc" returned: 0 in 0.645s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:13:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4bb98d-04bb-456f-8aad-ab83a5eaa955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0f86ed-c3b0-4b6f-ac5a-cee75ec69a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:44 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Volume volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc (cebe6c8c-4fd2-44f4-b727-881e78a516dc): created successfully Jul 06 21:13:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0f86ed-c3b0-4b6f-ac5a-cee75ec69a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:44 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Flow 'volume_create_manager' (c84efcf1-af60-45c8-8f6e-dad2f49f56c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:44 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-fa62cc1d-995f-468d-8169-3ddff49fd9be tempest-ProjectReaderTests-2066788325 None] Created volume successfully. Jul 06 21:13:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:44 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] Creating offline snapshot 99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52 of volume cebe6c8c-4fd2-44f4-b727-881e78a516dc {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:13:44 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9981ed-c290-438c-9aed-dba65d69f5d6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:44 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc Jul 06 21:13:44 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:45 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc" returned: 0 in 0.735s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:45 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52 1G Jul 06 21:13:45 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:46 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52 1G" returned: 0 in 0.756s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:46 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52 Jul 06 21:13:46 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:46 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52" returned: 0 in 0.665s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:46 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52 is being set with open permissions: ugo+rw Jul 06 21:13:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:47 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52 Jul 06 21:13:47 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:47 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52" returned: 0 in 0.599s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:47 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.info Jul 06 21:13:47 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:48 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.info" returned: 0 in 0.605s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:48 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.info is being set with open permissions: ugo+rw Jul 06 21:13:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:48 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.info Jul 06 21:13:48 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:48 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.info" returned: 0 in 0.604s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.040s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:48 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-519c5675-d14f-4535-a38d-552e119b99e5 tempest-ProjectReaderTests-2066788325 None] Create snapshot completed successfully Jul 06 21:13:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-quobyte-cebe6c8c-4fd2-44f4-b727-881e78a516dc" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-cebe6c8c-4fd2-44f4-b727-881e78a516dc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-quobyte-99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:49 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] Deleting offline snapshot 99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52 of volume cebe6c8c-4fd2-44f4-b727-881e78a516dc {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:13:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] snapshot_file for this snap is: volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:13:49 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5841897f-52a2-4d11-8f9d-d26f4216ad2c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:49 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52 Jul 06 21:13:49 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:49 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52" returned: 0 in 0.728s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:49 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:13:49 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[3842c5b0-4e37-4d10-8ffe-1e2534b27fc1]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:49 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc Jul 06 21:13:49 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:50 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc" returned: 0 in 0.706s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:50 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52 Jul 06 21:13:50 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:51 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52" returned: 0 in 0.694s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:51 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52 Jul 06 21:13:51 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:51 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc.99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52" returned: 0 in 0.617s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52" released by "_delete_snapshot" :: held 2.829s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:51 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-cebe6c8c-4fd2-44f4-b727-881e78a516dc" released by "delete_snapshot" :: held 2.852s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:51 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] Created reservations ['2a9e749e-894d-472a-a4d8-cab2ea022962', '02bdc2cb-05f3-4e58-8c22-10faedc5ba9f', '5ac6af2d-8a24-4d66-8f0c-4f1199bbd679', 'ed90aa02-72be-43a3-bcc8-1c3ecf96d3b7'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:13:52 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] Delete snapshot completed successfully. Jul 06 21:13:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-e5f7389e-1319-4d84-9d3f-252f4e962d17 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-99f6ed06-d0c5-4a9f-9ce0-f1b1b2a75e52-delete_snapshot" released by "delete_snapshot" :: held 2.982s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-cebe6c8c-4fd2-44f4-b727-881e78a516dc-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-cebe6c8c-4fd2-44f4-b727-881e78a516dc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-quobyte-cebe6c8c-4fd2-44f4-b727-881e78a516dc" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-cebe6c8c-4fd2-44f4-b727-881e78a516dc" acquired by "delete_volume" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:52 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d044f9-ee91-41c7-9fe9-aabc13a8ffc8]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:52 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc Jul 06 21:13:52 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:53 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc" returned: 0 in 0.706s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:53 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc Jul 06 21:13:53 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:53 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-cebe6c8c-4fd2-44f4-b727-881e78a516dc" returned: 0 in 0.603s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:53 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-cebe6c8c-4fd2-44f4-b727-881e78a516dc" released by "delete_volume" :: held 1.365s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:53 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] Created reservations ['284c764a-7d33-4e97-9e33-4c666910637e', 'a4f96ed4-4a6a-468a-8176-67a0af5b6db7', 'c7341825-a580-465b-8a13-acb98ab97507', 'd7f6ed8e-3ca5-41f4-a122-48c96f9ec6be'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:13:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:53 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:13:53 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:54 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.601s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:13:54 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] Deleted volume successfully. Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-d8b3330c-c8fa-4a3a-8d6e-89e2dbf21314 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-cebe6c8c-4fd2-44f4-b727-881e78a516dc-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Flow 'volume_create_manager' (dc7ec6b5-1771-413a-b7a4-89e38a59f552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf211e9-d391-4e9a-ba5f-35f31566ddb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf211e9-d391-4e9a-ba5f-35f31566ddb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2005869155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93696f04-44e9-4afa-8cad-da7e03e89fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b5a57c502043b181b88e5e69c037df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:55Z,use_quota=True,user_id='eef8550ba73d442cb6cb9e7fc1b1aa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ce4fc8-a03b-4b41-89f7-d1235aa10ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ce4fc8-a03b-4b41-89f7-d1235aa10ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46aabea0-3380-4e1f-a3e8-db487b07eaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46aabea0-3380-4e1f-a3e8-db487b07eaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93696f04-44e9-4afa-8cad-da7e03e89fb7', 'volume_name': 'volume-93696f04-44e9-4afa-8cad-da7e03e89fb7', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c038fd7-5053-4ced-841d-baa025c30196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c038fd7-5053-4ced-841d-baa025c30196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985c7b4c-5831-4d66-8804-bb54c8057792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:54 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Volume 93696f04-44e9-4afa-8cad-da7e03e89fb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93696f04-44e9-4afa-8cad-da7e03e89fb7', 'volume_size': 1} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2005869155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93696f04-44e9-4afa-8cad-da7e03e89fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b5a57c502043b181b88e5e69c037df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:55Z,use_quota=True,user_id='eef8550ba73d442cb6cb9e7fc1b1aa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Creating volume 93696f04-44e9-4afa-8cad-da7e03e89fb7 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:13:54 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:13:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:54 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7 1073741824 Jul 06 21:13:54 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:55 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7 1073741824" returned: 0 in 0.763s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:55 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7 Jul 06 21:13:55 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:56 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7" returned: 0 in 0.607s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:56 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:13:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985c7b4c-5831-4d66-8804-bb54c8057792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93696f04-44e9-4afa-8cad-da7e03e89fb7', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45895709-c3f0-4257-a94e-3789c29858be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:56 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Volume volume-93696f04-44e9-4afa-8cad-da7e03e89fb7 (93696f04-44e9-4afa-8cad-da7e03e89fb7): created successfully Jul 06 21:13:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45895709-c3f0-4257-a94e-3789c29858be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:56 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Flow 'volume_create_manager' (dc7ec6b5-1771-413a-b7a4-89e38a59f552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:56 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-4ac04acc-643a-4f99-bb26-d0525851fc72 tempest-ProjectReaderTests-2066788325 None] Created volume successfully. Jul 06 21:13:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] Creating offline snapshot 50b050b7-38c5-433c-8c60-b9d46f0db38f of volume 93696f04-44e9-4afa-8cad-da7e03e89fb7 {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:13:57 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e3cb2d-495a-4c73-8db5-c42f6fdca8fe]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:57 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7 Jul 06 21:13:57 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:57 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7" returned: 0 in 0.716s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:57 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f 1G Jul 06 21:13:57 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:13:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:58 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:13:58 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:58 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f 1G" returned: 0 in 0.783s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93696f04-44e9-4afa-8cad-da7e03e89fb7 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:58 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93696f04-44e9-4afa-8cad-da7e03e89fb7 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f Jul 06 21:13:58 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:58 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.646s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:13:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:13:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 29 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:13:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:13:59 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93696f04-44e9-4afa-8cad-da7e03e89fb7 -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f" returned: 0 in 0.638s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:59 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f is being set with open permissions: ugo+rw Jul 06 21:13:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:59 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f Jul 06 21:13:59 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:59 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f" returned: 0 in 0.626s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:59 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.info Jul 06 21:13:59 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:00 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.info" returned: 0 in 0.612s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:00 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.info is being set with open permissions: ugo+rw Jul 06 21:14:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:00 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.info Jul 06 21:14:00 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:01 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.info" returned: 0 in 0.622s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.075s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:01 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-ab9fc175-47c4-40fb-8022-b81e00537d10 tempest-ProjectReaderTests-2066788325 None] Create snapshot completed successfully Jul 06 21:14:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-50b050b7-38c5-433c-8c60-b9d46f0db38f-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] Lock "cinder-50b050b7-38c5-433c-8c60-b9d46f0db38f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-quobyte-93696f04-44e9-4afa-8cad-da7e03e89fb7" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-93696f04-44e9-4afa-8cad-da7e03e89fb7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-quobyte-50b050b7-38c5-433c-8c60-b9d46f0db38f" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-50b050b7-38c5-433c-8c60-b9d46f0db38f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] Deleting offline snapshot 50b050b7-38c5-433c-8c60-b9d46f0db38f of volume 93696f04-44e9-4afa-8cad-da7e03e89fb7 {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:14:02 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] snapshot_file for this snap is: volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:14:02 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[75781601-a651-47a7-8bad-0f814a8311fd]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:14:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:02 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f Jul 06 21:14:02 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:03 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f" returned: 0 in 0.729s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:03 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93696f04-44e9-4afa-8cad-da7e03e89fb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:14:03 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf3938c-8fed-403b-bd5c-9193e36f89b6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:14:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:03 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7 Jul 06 21:14:03 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:03 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7" returned: 0 in 0.712s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:03 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:03 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f Jul 06 21:14:03 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:04 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f" returned: 0 in 0.699s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:04 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:04 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f Jul 06 21:14:04 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:05 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7.50b050b7-38c5-433c-8c60-b9d46f0db38f" returned: 0 in 0.612s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-50b050b7-38c5-433c-8c60-b9d46f0db38f" released by "_delete_snapshot" :: held 2.838s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-93696f04-44e9-4afa-8cad-da7e03e89fb7" released by "delete_snapshot" :: held 2.859s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:05 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] Created reservations ['91b68c0d-a0a4-4f9e-85dd-e177fea30fa5', '1d27972f-8e1c-46f9-a8aa-a17c8739b1f6', '9191e71f-491c-4536-8399-1f6266c0ab84', '3c53ad0e-8b04-4df4-a900-00f9568ce81e'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:14:05 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] Delete snapshot completed successfully. Jul 06 21:14:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-89e05843-0c62-47ad-badb-38a29b6d01cf tempest-ProjectReaderTests-2066788325 None] Lock "cinder-50b050b7-38c5-433c-8c60-b9d46f0db38f-delete_snapshot" released by "delete_snapshot" :: held 2.986s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-93696f04-44e9-4afa-8cad-da7e03e89fb7-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-93696f04-44e9-4afa-8cad-da7e03e89fb7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-quobyte-93696f04-44e9-4afa-8cad-da7e03e89fb7" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:05 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-93696f04-44e9-4afa-8cad-da7e03e89fb7" acquired by "delete_volume" :: waited 0.013s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:05 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1c9e03-de7c-4fdf-aedd-7bcb192fb955]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:14:05 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:05 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7 Jul 06 21:14:05 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:06 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7" returned: 0 in 0.727s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:06 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7 Jul 06 21:14:06 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:06 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-93696f04-44e9-4afa-8cad-da7e03e89fb7" returned: 0 in 0.614s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:06 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-93696f04-44e9-4afa-8cad-da7e03e89fb7" released by "delete_volume" :: held 1.398s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:06 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] Created reservations ['3e7baa88-7811-4172-b322-091160805602', 'a8d303f1-c198-461d-acaf-af2acb07386c', '69a652f5-d73b-4e26-8f3a-3902a4a08983', '6dcc7dbf-0f56-49a1-b77a-84bc8671b7bc'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:14:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:06 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:06 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:06 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:14:06 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:07 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.625s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:07 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:14:07 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] Deleted volume successfully. Jul 06 21:14:07 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f029a176-aff3-4056-9cf6-b5bf4e3c69b2 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-93696f04-44e9-4afa-8cad-da7e03e89fb7-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Flow 'volume_create_manager' (e15b8854-eb7a-4cf2-a654-588475543f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf64ad7-4941-4a77-9232-cfb6d3a3da90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf64ad7-4941-4a77-9232-cfb6d3a3da90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1440673092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53de3d1d-fbc1-4876-b331-2ff507f1fa1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b5a57c502043b181b88e5e69c037df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:14:08Z,use_quota=True,user_id='eef8550ba73d442cb6cb9e7fc1b1aa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949f7fd6-fc16-4d57-b872-05a322f73b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949f7fd6-fc16-4d57-b872-05a322f73b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff2b925-19b8-4d08-a808-9346265a3528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff2b925-19b8-4d08-a808-9346265a3528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53de3d1d-fbc1-4876-b331-2ff507f1fa1a', 'volume_name': 'volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cacfce5c-8245-4c98-a69b-d680fdf40a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cacfce5c-8245-4c98-a69b-d680fdf40a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06680c09-3c9b-43e8-94d9-7fec2b1fe6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:08 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Volume 53de3d1d-fbc1-4876-b331-2ff507f1fa1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a', 'volume_size': 1} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1440673092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53de3d1d-fbc1-4876-b331-2ff507f1fa1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b5a57c502043b181b88e5e69c037df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:14:08Z,use_quota=True,user_id='eef8550ba73d442cb6cb9e7fc1b1aa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Creating volume 53de3d1d-fbc1-4876-b331-2ff507f1fa1a {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:14:08 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:08 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a 1073741824 Jul 06 21:14:08 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:08 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a 1073741824" returned: 0 in 0.772s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:08 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:08 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a Jul 06 21:14:08 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:09 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a" returned: 0 in 0.616s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:09 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:14:09 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06680c09-3c9b-43e8-94d9-7fec2b1fe6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e64f9038-54eb-40e6-be3b-a2a850b936fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:09 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Volume volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a (53de3d1d-fbc1-4876-b331-2ff507f1fa1a): created successfully Jul 06 21:14:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e64f9038-54eb-40e6-be3b-a2a850b936fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:09 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Flow 'volume_create_manager' (e15b8854-eb7a-4cf2-a654-588475543f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:14:09 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-a4c8aed1-9b42-4c93-a6b0-64be05572fe3 tempest-ProjectReaderTests-2066788325 None] Created volume successfully. Jul 06 21:14:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:10 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] Creating offline snapshot d0f0f750-f838-42c0-a4b9-cef36773588d of volume 53de3d1d-fbc1-4876-b331-2ff507f1fa1a {{(pid=87207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:14:10 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68d2907-5ad0-452d-92ac-376ce406b599]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:14:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:10 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a Jul 06 21:14:10 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:10 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a" returned: 0 in 0.717s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:10 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d 1G {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:11 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d 1G Jul 06 21:14:11 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:11 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d 1G" returned: 0 in 0.762s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:11 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:11 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d Jul 06 21:14:11 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:12 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a -F qcow2 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d" returned: 0 in 0.665s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:12 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d is being set with open permissions: ugo+rw Jul 06 21:14:12 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:12 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d Jul 06 21:14:12 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:13 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d" returned: 0 in 0.608s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:13 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.info Jul 06 21:14:13 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:13 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.info" returned: 0 in 0.621s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:13 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.remotefs [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.info is being set with open permissions: ugo+rw Jul 06 21:14:13 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.info {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:13 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.info Jul 06 21:14:13 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:14 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.info" returned: 0 in 0.608s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.058s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:14 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-b009cf7f-b3d6-499b-8171-cad313b389c1 tempest-ProjectReaderTests-2066788325 None] Create snapshot completed successfully Jul 06 21:14:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-d0f0f750-f838-42c0-a4b9-cef36773588d-delete_snapshot" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-d0f0f750-f838-42c0-a4b9-cef36773588d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-quobyte-53de3d1d-fbc1-4876-b331-2ff507f1fa1a" by "delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-53de3d1d-fbc1-4876-b331-2ff507f1fa1a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-quobyte-d0f0f750-f838-42c0-a4b9-cef36773588d" by "_delete_snapshot" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:14 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-d0f0f750-f838-42c0-a4b9-cef36773588d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] Deleting offline snapshot d0f0f750-f838-42c0-a4b9-cef36773588d of volume 53de3d1d-fbc1-4876-b331-2ff507f1fa1a {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:14:14 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] snapshot_file for this snap is: volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d {{(pid=87207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:14:14 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d9240a-86bf-43a1-8254-d6580b14db8a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:14:14 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:14 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d Jul 06 21:14:14 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:15 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d" returned: 0 in 0.717s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:15 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:14:15 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7033e6d2-9b26-4848-b6a1-75ceb50b78f9]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:14:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:15 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a Jul 06 21:14:15 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:15 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a" returned: 0 in 0.717s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:15 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:15 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d Jul 06 21:14:15 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:16 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d" returned: 0 in 0.679s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:16 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:16 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d Jul 06 21:14:16 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:17 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a.d0f0f750-f838-42c0-a4b9-cef36773588d" returned: 0 in 0.629s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-d0f0f750-f838-42c0-a4b9-cef36773588d" released by "_delete_snapshot" :: held 2.825s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-53de3d1d-fbc1-4876-b331-2ff507f1fa1a" released by "delete_snapshot" :: held 2.845s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:17 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] Created reservations ['9add50ed-7e3c-4f8f-a6f8-cb8d440fcf86', '766a1266-0f0b-4b00-a243-45392f1b9721', 'd5975554-c7f4-495c-8ffe-1533bea80dd9', '5802a306-9633-4409-9bca-a88b2acb3209'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:14:17 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] Delete snapshot completed successfully. Jul 06 21:14:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-3f919594-9dde-4a14-a4ae-f3f1012e77b7 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-d0f0f750-f838-42c0-a4b9-cef36773588d-delete_snapshot" released by "delete_snapshot" :: held 2.969s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-53de3d1d-fbc1-4876-b331-2ff507f1fa1a-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-53de3d1d-fbc1-4876-b331-2ff507f1fa1a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "cinder-quobyte-53de3d1d-fbc1-4876-b331-2ff507f1fa1a" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:17 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-53de3d1d-fbc1-4876-b331-2ff507f1fa1a" acquired by "delete_volume" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:17 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d075d15-be5f-41e1-8e64-f1ec830c8955]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:14:17 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:17 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a Jul 06 21:14:17 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:18 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a" returned: 0 in 0.702s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:18 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:18 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a Jul 06 21:14:18 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:19 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-53de3d1d-fbc1-4876-b331-2ff507f1fa1a" returned: 0 in 0.615s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-quobyte-53de3d1d-fbc1-4876-b331-2ff507f1fa1a" released by "delete_volume" :: held 1.370s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:19 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] Created reservations ['12c5fc5d-dbf2-44cd-bf93-3f3420d16de7', '05d53778-b29d-461e-be9f-c6333d86e99d', '311e989d-fc6d-4006-a40f-ea6f0824559c', '30899633-0d7d-4800-93c7-51d271c19c46'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:14:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:19 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:19 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:19 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:14:19 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:19 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:19 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.618s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:19 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:14:19 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] Deleted volume successfully. Jul 06 21:14:19 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-af984ee7-9046-454c-a330-e302f9e9c402 tempest-ProjectReaderTests-2066788325 None] Lock "cinder-53de3d1d-fbc1-4876-b331-2ff507f1fa1a-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:29 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:UPDATE=65,cinder:SELECT=44,cinder:DELETE=6,cinder:INSERT=15 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:14:29 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=46,cinder:INSERT=19,cinder:UPDATE=58,cinder:DELETE=4 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:14:30 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Flow 'volume_create_manager' (49e61068-88d9-4b37-bc6a-13be06f67126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46befd2b-eec8-4b07-99c0-8b964db3917d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46befd2b-eec8-4b07-99c0-8b964db3917d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-445716093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8fbfd3d-8904-4afb-8f48-1d382a17451f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066f0f8237f142b69a3d4c10f2879106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:14:31Z,use_quota=True,user_id='573074c7e07246e682d003283d0e091b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892563f7-6f31-4425-b604-50b930479093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892563f7-6f31-4425-b604-50b930479093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9347190-db29-4377-8596-e809fce6cefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9347190-db29-4377-8596-e809fce6cefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8fbfd3d-8904-4afb-8f48-1d382a17451f', 'volume_name': 'volume-c8fbfd3d-8904-4afb-8f48-1d382a17451f', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6dddc2-0ed9-4533-a0df-490017784f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6dddc2-0ed9-4533-a0df-490017784f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7f5955-b432-4787-9732-bad2b693994d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:31 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Volume c8fbfd3d-8904-4afb-8f48-1d382a17451f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8fbfd3d-8904-4afb-8f48-1d382a17451f', 'volume_size': 1} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-445716093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8fbfd3d-8904-4afb-8f48-1d382a17451f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066f0f8237f142b69a3d4c10f2879106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:14:31Z,use_quota=True,user_id='573074c7e07246e682d003283d0e091b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Creating volume c8fbfd3d-8904-4afb-8f48-1d382a17451f {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:14:31 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8fbfd3d-8904-4afb-8f48-1d382a17451f 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:31 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8fbfd3d-8904-4afb-8f48-1d382a17451f 1073741824 Jul 06 21:14:31 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:31 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8fbfd3d-8904-4afb-8f48-1d382a17451f 1073741824" returned: 0 in 0.821s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:31 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8fbfd3d-8904-4afb-8f48-1d382a17451f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:31 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8fbfd3d-8904-4afb-8f48-1d382a17451f Jul 06 21:14:31 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:32 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8fbfd3d-8904-4afb-8f48-1d382a17451f" returned: 0 in 0.618s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:32 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:14:32 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:32 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7f5955-b432-4787-9732-bad2b693994d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8fbfd3d-8904-4afb-8f48-1d382a17451f', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:32 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ce5fd7-d8d2-43ee-b1af-8b36b9b6df09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:32 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Volume volume-c8fbfd3d-8904-4afb-8f48-1d382a17451f (c8fbfd3d-8904-4afb-8f48-1d382a17451f): created successfully Jul 06 21:14:32 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ce5fd7-d8d2-43ee-b1af-8b36b9b6df09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:32 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Flow 'volume_create_manager' (49e61068-88d9-4b37-bc6a-13be06f67126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:14:32 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-6be2f1e7-a88b-4e4b-a7ab-f8ef8f9624a6 tempest-ProjectReaderTests-1910275402 None] Created volume successfully. Jul 06 21:14:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] Acquiring lock "cinder-c8fbfd3d-8904-4afb-8f48-1d382a17451f-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] Lock "cinder-c8fbfd3d-8904-4afb-8f48-1d382a17451f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] Acquiring lock "cinder-quobyte-c8fbfd3d-8904-4afb-8f48-1d382a17451f" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:33 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] Lock "cinder-quobyte-c8fbfd3d-8904-4afb-8f48-1d382a17451f" acquired by "delete_volume" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:33 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fa85e5-e69f-47d5-a2fd-ee3cbe377e55]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:14:33 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8fbfd3d-8904-4afb-8f48-1d382a17451f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:33 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8fbfd3d-8904-4afb-8f48-1d382a17451f Jul 06 21:14:33 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:34 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8fbfd3d-8904-4afb-8f48-1d382a17451f" returned: 0 in 0.735s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8fbfd3d-8904-4afb-8f48-1d382a17451f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:34 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8fbfd3d-8904-4afb-8f48-1d382a17451f Jul 06 21:14:34 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:34 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-c8fbfd3d-8904-4afb-8f48-1d382a17451f" returned: 0 in 0.650s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:34 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] Lock "cinder-quobyte-c8fbfd3d-8904-4afb-8f48-1d382a17451f" released by "delete_volume" :: held 1.422s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:34 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] Created reservations ['c80bb689-e2ae-4b15-8177-fc720a869ee9', '89ab44a3-de6d-401c-a246-a37a1086583c', 'af511ed0-a7b7-41b8-a588-f00e71e60105', 'ba810066-5968-4e9d-9a6b-798486b33e8e'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:14:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:34 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:34 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:34 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:14:34 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:35 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.633s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:14:35 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] Deleted volume successfully. Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-b26f57bc-42c5-47aa-bb31-1f71f05d5aa5 tempest-ProjectReaderTests-1910275402 None] Lock "cinder-c8fbfd3d-8904-4afb-8f48-1d382a17451f-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Flow 'volume_create_manager' (4bbe5053-8ee9-4129-9ba2-6502452617da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e73a15-f34f-4545-94c7-151fed01d55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e73a15-f34f-4545-94c7-151fed01d55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1660985884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d1f1c75-31ca-4516-83cb-4e29c6294079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066f0f8237f142b69a3d4c10f2879106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:14:36Z,use_quota=True,user_id='573074c7e07246e682d003283d0e091b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b36b5dc-1ac6-41b6-82e9-0223029b1c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b36b5dc-1ac6-41b6-82e9-0223029b1c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016d9421-0b92-4656-ba19-3628773923da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016d9421-0b92-4656-ba19-3628773923da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d1f1c75-31ca-4516-83cb-4e29c6294079', 'volume_name': 'volume-5d1f1c75-31ca-4516-83cb-4e29c6294079', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60822415-be6b-49bf-96a0-ac6c9124d40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60822415-be6b-49bf-96a0-ac6c9124d40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2d1ece-0562-40bc-bd87-c35581c824fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:35 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Volume 5d1f1c75-31ca-4516-83cb-4e29c6294079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d1f1c75-31ca-4516-83cb-4e29c6294079', 'volume_size': 1} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1660985884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d1f1c75-31ca-4516-83cb-4e29c6294079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066f0f8237f142b69a3d4c10f2879106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:14:36Z,use_quota=True,user_id='573074c7e07246e682d003283d0e091b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Creating volume 5d1f1c75-31ca-4516-83cb-4e29c6294079 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:14:35 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:14:35 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5d1f1c75-31ca-4516-83cb-4e29c6294079 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:35 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5d1f1c75-31ca-4516-83cb-4e29c6294079 1073741824 Jul 06 21:14:35 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:36 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5d1f1c75-31ca-4516-83cb-4e29c6294079 1073741824" returned: 0 in 0.792s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:36 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5d1f1c75-31ca-4516-83cb-4e29c6294079 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:36 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5d1f1c75-31ca-4516-83cb-4e29c6294079 Jul 06 21:14:36 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:37 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5d1f1c75-31ca-4516-83cb-4e29c6294079" returned: 0 in 0.639s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:37 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:14:37 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:37 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2d1ece-0562-40bc-bd87-c35581c824fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d1f1c75-31ca-4516-83cb-4e29c6294079', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:37 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b150c42-9271-4393-8b5b-ed6005444527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:37 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Volume volume-5d1f1c75-31ca-4516-83cb-4e29c6294079 (5d1f1c75-31ca-4516-83cb-4e29c6294079): created successfully Jul 06 21:14:37 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b150c42-9271-4393-8b5b-ed6005444527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:37 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Flow 'volume_create_manager' (4bbe5053-8ee9-4129-9ba2-6502452617da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:14:37 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-1dc7503b-7af1-4ecb-add7-4aa0416390de tempest-ProjectReaderTests-1910275402 None] Created volume successfully. Jul 06 21:14:37 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] Acquiring lock "cinder-5d1f1c75-31ca-4516-83cb-4e29c6294079-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:37 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] Lock "cinder-5d1f1c75-31ca-4516-83cb-4e29c6294079-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] Acquiring lock "cinder-quobyte-5d1f1c75-31ca-4516-83cb-4e29c6294079" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:38 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] Lock "cinder-quobyte-5d1f1c75-31ca-4516-83cb-4e29c6294079" acquired by "delete_volume" :: waited 0.014s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:38 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedb150c-4de4-4857-b779-2414266ba864]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:14:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5d1f1c75-31ca-4516-83cb-4e29c6294079 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:38 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5d1f1c75-31ca-4516-83cb-4e29c6294079 Jul 06 21:14:38 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:38 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5d1f1c75-31ca-4516-83cb-4e29c6294079" returned: 0 in 0.733s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:38 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5d1f1c75-31ca-4516-83cb-4e29c6294079 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:38 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5d1f1c75-31ca-4516-83cb-4e29c6294079 Jul 06 21:14:38 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:39 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-5d1f1c75-31ca-4516-83cb-4e29c6294079" returned: 0 in 0.633s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:39 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] Lock "cinder-quobyte-5d1f1c75-31ca-4516-83cb-4e29c6294079" released by "delete_volume" :: held 1.403s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:39 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] Created reservations ['f8314401-678a-4b72-8733-702a4d06b8b3', '816ff0ae-670e-41c9-832f-13c76d2028cc', '775aa0a2-6886-4fb8-b92a-f147fd6c7edf', '23fc831f-772a-4276-8fa8-27a203d591d4'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:14:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:39 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:39 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:39 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:14:39 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:40 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.621s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:40 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:14:40 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] Deleted volume successfully. Jul 06 21:14:40 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-f2c12730-d991-4ac4-a50e-d10e76367998 tempest-ProjectReaderTests-1910275402 None] Lock "cinder-5d1f1c75-31ca-4516-83cb-4e29c6294079-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Flow 'volume_create_manager' (97d1e947-c9aa-4565-9ec0-fc77590271b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da7619b-02f8-4aa7-8438-b79fcf0e0025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da7619b-02f8-4aa7-8438-b79fcf0e0025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-722556654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908f4e9b-7555-4bb3-9563-2c1fd74be5e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c122bfc929fc4bc3878cbdebbed4419a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:14:44Z,use_quota=True,user_id='f7a2fd9d48c84898a545ef42e745e4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d26586-0820-4e4c-82d4-d13abf84ddba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d26586-0820-4e4c-82d4-d13abf84ddba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147d0c96-d5b0-462c-a226-d42f9b57b16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147d0c96-d5b0-462c-a226-d42f9b57b16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '908f4e9b-7555-4bb3-9563-2c1fd74be5e5', 'volume_name': 'volume-908f4e9b-7555-4bb3-9563-2c1fd74be5e5', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d192f284-2cb0-49fe-8f34-45139b97a0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d192f284-2cb0-49fe-8f34-45139b97a0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26cbfd0-8876-4d3c-a60d-12c104ee51b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:43 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Volume 908f4e9b-7555-4bb3-9563-2c1fd74be5e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-908f4e9b-7555-4bb3-9563-2c1fd74be5e5', 'volume_size': 1} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-722556654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908f4e9b-7555-4bb3-9563-2c1fd74be5e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c122bfc929fc4bc3878cbdebbed4419a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:14:44Z,use_quota=True,user_id='f7a2fd9d48c84898a545ef42e745e4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Creating volume 908f4e9b-7555-4bb3-9563-2c1fd74be5e5 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:14:43 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:14:43 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-908f4e9b-7555-4bb3-9563-2c1fd74be5e5 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:43 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-908f4e9b-7555-4bb3-9563-2c1fd74be5e5 1073741824 Jul 06 21:14:43 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:44 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-908f4e9b-7555-4bb3-9563-2c1fd74be5e5 1073741824" returned: 0 in 0.864s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:44 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-908f4e9b-7555-4bb3-9563-2c1fd74be5e5 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:44 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-908f4e9b-7555-4bb3-9563-2c1fd74be5e5 Jul 06 21:14:44 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:45 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-908f4e9b-7555-4bb3-9563-2c1fd74be5e5" returned: 0 in 0.664s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:45 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:14:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26cbfd0-8876-4d3c-a60d-12c104ee51b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-908f4e9b-7555-4bb3-9563-2c1fd74be5e5', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb6d45a-08fe-4477-9b4c-1547e4e0fa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:45 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Volume volume-908f4e9b-7555-4bb3-9563-2c1fd74be5e5 (908f4e9b-7555-4bb3-9563-2c1fd74be5e5): created successfully Jul 06 21:14:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb6d45a-08fe-4477-9b4c-1547e4e0fa92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:45 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Flow 'volume_create_manager' (97d1e947-c9aa-4565-9ec0-fc77590271b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:14:45 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-8ddf7047-7c3d-481e-b436-20a914870245 tempest-ProjectReaderTests-1980588721 None] Created volume successfully. Jul 06 21:14:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] Acquiring lock "cinder-908f4e9b-7555-4bb3-9563-2c1fd74be5e5-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] Lock "cinder-908f4e9b-7555-4bb3-9563-2c1fd74be5e5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] Acquiring lock "cinder-quobyte-908f4e9b-7555-4bb3-9563-2c1fd74be5e5" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:45 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] Lock "cinder-quobyte-908f4e9b-7555-4bb3-9563-2c1fd74be5e5" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:45 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0cc97c-9dc6-4661-b7d9-e806987f2c77]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:14:45 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-908f4e9b-7555-4bb3-9563-2c1fd74be5e5 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:46 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-908f4e9b-7555-4bb3-9563-2c1fd74be5e5 Jul 06 21:14:46 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:46 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-908f4e9b-7555-4bb3-9563-2c1fd74be5e5" returned: 0 in 0.780s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-908f4e9b-7555-4bb3-9563-2c1fd74be5e5 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:46 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-908f4e9b-7555-4bb3-9563-2c1fd74be5e5 Jul 06 21:14:46 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:47 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-908f4e9b-7555-4bb3-9563-2c1fd74be5e5" returned: 0 in 0.638s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:47 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] Lock "cinder-quobyte-908f4e9b-7555-4bb3-9563-2c1fd74be5e5" released by "delete_volume" :: held 1.456s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:47 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] Created reservations ['8508c539-f657-4e27-ac6e-74a56b5a1556', 'd205899a-5793-456c-abe2-dca857811fb3', '3036e243-39ce-4160-ac50-a7766c3f828d', '40b157cb-394f-4205-bc75-bfac1f0e2f6a'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:14:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:47 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:47 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:47 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:14:47 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:48 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.618s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:14:48 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] Deleted volume successfully. Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-a93acf4f-62a5-4eb3-a20a-be6a0a777d78 tempest-ProjectReaderTests-1980588721 None] Lock "cinder-908f4e9b-7555-4bb3-9563-2c1fd74be5e5-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Flow 'volume_create_manager' (ba3063f2-284c-446d-a390-7115f6240434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabba419-ddbc-4a8d-9242-8f14502ab542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabba419-ddbc-4a8d-9242-8f14502ab542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983592325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad57535e-9e79-4fbe-944f-b3aa8b26b735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c122bfc929fc4bc3878cbdebbed4419a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:14:48Z,use_quota=True,user_id='f7a2fd9d48c84898a545ef42e745e4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f32e7c-b84f-42a8-b32b-f110a55ac762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f32e7c-b84f-42a8-b32b-f110a55ac762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d8a2c5-b7ea-40d1-9512-5d073deeef61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d8a2c5-b7ea-40d1-9512-5d073deeef61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad57535e-9e79-4fbe-944f-b3aa8b26b735', 'volume_name': 'volume-ad57535e-9e79-4fbe-944f-b3aa8b26b735', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7f6564-cec9-4a8b-a2b3-13cf307d004a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7f6564-cec9-4a8b-a2b3-13cf307d004a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84927cf-63e8-413a-aa96-ea2c90ca5f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:48 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Volume ad57535e-9e79-4fbe-944f-b3aa8b26b735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad57535e-9e79-4fbe-944f-b3aa8b26b735', 'volume_size': 1} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983592325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad57535e-9e79-4fbe-944f-b3aa8b26b735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c122bfc929fc4bc3878cbdebbed4419a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:14:48Z,use_quota=True,user_id='f7a2fd9d48c84898a545ef42e745e4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Creating volume ad57535e-9e79-4fbe-944f-b3aa8b26b735 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:14:48 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:14:48 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad57535e-9e79-4fbe-944f-b3aa8b26b735 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:48 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad57535e-9e79-4fbe-944f-b3aa8b26b735 1073741824 Jul 06 21:14:48 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:49 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad57535e-9e79-4fbe-944f-b3aa8b26b735 1073741824" returned: 0 in 0.788s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:49 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad57535e-9e79-4fbe-944f-b3aa8b26b735 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:49 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad57535e-9e79-4fbe-944f-b3aa8b26b735 Jul 06 21:14:49 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:50 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad57535e-9e79-4fbe-944f-b3aa8b26b735" returned: 0 in 0.646s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:50 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:14:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84927cf-63e8-413a-aa96-ea2c90ca5f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad57535e-9e79-4fbe-944f-b3aa8b26b735', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5740fb9e-2d26-498f-a4b3-9184b82852b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:50 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Volume volume-ad57535e-9e79-4fbe-944f-b3aa8b26b735 (ad57535e-9e79-4fbe-944f-b3aa8b26b735): created successfully Jul 06 21:14:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5740fb9e-2d26-498f-a4b3-9184b82852b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:50 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Flow 'volume_create_manager' (ba3063f2-284c-446d-a390-7115f6240434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:14:50 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-22f3aa82-56b1-4333-a20b-6c2bf389216b tempest-ProjectReaderTests-1980588721 None] Created volume successfully. Jul 06 21:14:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] Acquiring lock "cinder-ad57535e-9e79-4fbe-944f-b3aa8b26b735-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] Lock "cinder-ad57535e-9e79-4fbe-944f-b3aa8b26b735-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] Acquiring lock "cinder-quobyte-ad57535e-9e79-4fbe-944f-b3aa8b26b735" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:50 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] Lock "cinder-quobyte-ad57535e-9e79-4fbe-944f-b3aa8b26b735" acquired by "delete_volume" :: waited 0.015s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:50 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e1518c-ebbb-4b27-917f-adf7608dd035]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:14:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad57535e-9e79-4fbe-944f-b3aa8b26b735 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:50 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad57535e-9e79-4fbe-944f-b3aa8b26b735 Jul 06 21:14:50 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:51 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad57535e-9e79-4fbe-944f-b3aa8b26b735" returned: 0 in 0.730s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:51 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad57535e-9e79-4fbe-944f-b3aa8b26b735 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:51 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad57535e-9e79-4fbe-944f-b3aa8b26b735 Jul 06 21:14:51 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:52 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad57535e-9e79-4fbe-944f-b3aa8b26b735" returned: 0 in 0.658s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] Lock "cinder-quobyte-ad57535e-9e79-4fbe-944f-b3aa8b26b735" released by "delete_volume" :: held 1.424s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:52 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] Created reservations ['6adc5a92-7f55-45b6-916e-d2ae68839636', 'a52a4aba-ba76-4870-baf3-548979554f4e', 'c5658f4e-54f3-4398-b0f9-aed41ca4bb56', 'c550fb0d-3965-4fe0-ac69-5a0711782fa5'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:14:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:52 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:52 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:14:52 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:52 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:52 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.635s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:52 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:14:52 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] Deleted volume successfully. Jul 06 21:14:52 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-0dd1bcdf-2143-47dc-8023-9551e7ec80e9 tempest-ProjectReaderTests-1980588721 None] Lock "cinder-ad57535e-9e79-4fbe-944f-b3aa8b26b735-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Flow 'volume_create_manager' (732625b7-cc86-42b7-bce5-4626772bab71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (febabda9-6cf7-4714-a3cd-51dba1d79fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (febabda9-6cf7-4714-a3cd-51dba1d79fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1446087666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad97c8e4-fbca-4dfc-ba91-7e6570340498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c122bfc929fc4bc3878cbdebbed4419a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:14:53Z,use_quota=True,user_id='f7a2fd9d48c84898a545ef42e745e4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f724cc-d954-4e94-ba95-d6dd7080fc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f724cc-d954-4e94-ba95-d6dd7080fc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffe18be-ee64-4a2e-938b-ad986b0606bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffe18be-ee64-4a2e-938b-ad986b0606bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad97c8e4-fbca-4dfc-ba91-7e6570340498', 'volume_name': 'volume-ad97c8e4-fbca-4dfc-ba91-7e6570340498', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39affa55-51b2-4d84-bca9-a2e88756c014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39affa55-51b2-4d84-bca9-a2e88756c014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb27acd8-e2d2-4d65-b4cc-b181a474ebe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:53 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Volume ad97c8e4-fbca-4dfc-ba91-7e6570340498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad97c8e4-fbca-4dfc-ba91-7e6570340498', 'volume_size': 1} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1446087666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad97c8e4-fbca-4dfc-ba91-7e6570340498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c122bfc929fc4bc3878cbdebbed4419a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:14:53Z,use_quota=True,user_id='f7a2fd9d48c84898a545ef42e745e4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Creating volume ad97c8e4-fbca-4dfc-ba91-7e6570340498 {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:14:53 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:14:53 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad97c8e4-fbca-4dfc-ba91-7e6570340498 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:53 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad97c8e4-fbca-4dfc-ba91-7e6570340498 1073741824 Jul 06 21:14:53 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:54 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad97c8e4-fbca-4dfc-ba91-7e6570340498 1073741824" returned: 0 in 0.836s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad97c8e4-fbca-4dfc-ba91-7e6570340498 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:54 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad97c8e4-fbca-4dfc-ba91-7e6570340498 Jul 06 21:14:54 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:54 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad97c8e4-fbca-4dfc-ba91-7e6570340498" returned: 0 in 0.650s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:54 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:14:54 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb27acd8-e2d2-4d65-b4cc-b181a474ebe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad97c8e4-fbca-4dfc-ba91-7e6570340498', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cddd7b7-7ad1-4dc5-a18b-c18d1e010f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:54 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Volume volume-ad97c8e4-fbca-4dfc-ba91-7e6570340498 (ad97c8e4-fbca-4dfc-ba91-7e6570340498): created successfully Jul 06 21:14:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cddd7b7-7ad1-4dc5-a18b-c18d1e010f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:54 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Flow 'volume_create_manager' (732625b7-cc86-42b7-bce5-4626772bab71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:14:54 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-0313dbe5-be14-44f9-940f-a16ff17308f0 tempest-ProjectReaderTests-1980588721 None] Created volume successfully. Jul 06 21:14:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] Acquiring lock "cinder-ad97c8e4-fbca-4dfc-ba91-7e6570340498-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] Lock "cinder-ad97c8e4-fbca-4dfc-ba91-7e6570340498-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] Acquiring lock "cinder-quobyte-ad97c8e4-fbca-4dfc-ba91-7e6570340498" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:55 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] Lock "cinder-quobyte-ad97c8e4-fbca-4dfc-ba91-7e6570340498" acquired by "delete_volume" :: waited 0.017s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:55 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[90413bb4-82d9-434d-8e4b-9d6f2a2bd6d3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:14:55 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad97c8e4-fbca-4dfc-ba91-7e6570340498 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:55 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad97c8e4-fbca-4dfc-ba91-7e6570340498 Jul 06 21:14:55 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:56 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad97c8e4-fbca-4dfc-ba91-7e6570340498" returned: 0 in 0.799s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad97c8e4-fbca-4dfc-ba91-7e6570340498 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:56 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad97c8e4-fbca-4dfc-ba91-7e6570340498 Jul 06 21:14:56 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:56 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:56 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-ad97c8e4-fbca-4dfc-ba91-7e6570340498" returned: 0 in 0.639s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:56 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] Lock "cinder-quobyte-ad97c8e4-fbca-4dfc-ba91-7e6570340498" released by "delete_volume" :: held 1.477s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:57 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] Created reservations ['6793062f-0fcf-4a3b-a9aa-2d05e4638f27', '2a4354f3-9d4f-4236-8ff6-f6316d349442', '300e9e9c-1932-4c66-8e17-7eefd3afbc83', '55acf71b-43d0-4a09-b2d5-28f34afc2feb'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:14:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:57 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:57 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:14:57 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:57 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:57 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.678s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:57 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:14:57 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] Deleted volume successfully. Jul 06 21:14:57 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-da1d4428-e4b7-4120-81ec-99d1ddbc506f tempest-ProjectReaderTests-1980588721 None] Lock "cinder-ad97c8e4-fbca-4dfc-ba91-7e6570340498-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:58 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:14:58 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Flow 'volume_create_manager' (86fef955-4e58-4d8d-91c1-fdedc7443cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e594208-f767-4d47-ba1c-7f9148983dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e594208-f767-4d47-ba1c-7f9148983dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2044681024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8bee289-d965-487b-bdb1-a3bc2ab0252d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c122bfc929fc4bc3878cbdebbed4419a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:14:58Z,use_quota=True,user_id='f7a2fd9d48c84898a545ef42e745e4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6706c3-5598-4ab8-97b0-7cdc600a4155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6706c3-5598-4ab8-97b0-7cdc600a4155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8595bcc6-bc3b-4279-af6d-d3c8535476dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8595bcc6-bc3b-4279-af6d-d3c8535476dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8bee289-d965-487b-bdb1-a3bc2ab0252d', 'volume_name': 'volume-f8bee289-d965-487b-bdb1-a3bc2ab0252d', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97a3eb6-a23b-4b37-950f-281d7bd285bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97a3eb6-a23b-4b37-950f-281d7bd285bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be11f2ef-8c49-4c92-be06-7f898dac1ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:58 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Volume f8bee289-d965-487b-bdb1-a3bc2ab0252d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8bee289-d965-487b-bdb1-a3bc2ab0252d', 'volume_size': 1} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2044681024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8bee289-d965-487b-bdb1-a3bc2ab0252d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c122bfc929fc4bc3878cbdebbed4419a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:14:58Z,use_quota=True,user_id='f7a2fd9d48c84898a545ef42e745e4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98b0b86d-ff79-4940-9875-51edb977bc93),volume_type_id=98b0b86d-ff79-4940-9875-51edb977bc93)}" {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Creating volume f8bee289-d965-487b-bdb1-a3bc2ab0252d {{(pid=87207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Selected osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 as target Quobyte volume. {{(pid=87207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:14:58 devstack cinder-volume[87207]: INFO cinder.volume.drivers.remotefs [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] casted to osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15 Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f8bee289-d965-487b-bdb1-a3bc2ab0252d 1073741824 {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:58 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f8bee289-d965-487b-bdb1-a3bc2ab0252d 1073741824 Jul 06 21:14:58 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:58 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.631s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG oslo_service.periodic_task [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=87207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread count: 29 {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:14:58 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-05f71dc9-7d64-4bdc-89f6-d2f77aca0cd7 None None] thread info: [<_MainThread(MainThread, started 138307652206720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:14:59 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f8bee289-d965-487b-bdb1-a3bc2ab0252d 1073741824" returned: 0 in 0.831s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f8bee289-d965-487b-bdb1-a3bc2ab0252d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:59 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f8bee289-d965-487b-bdb1-a3bc2ab0252d Jul 06 21:14:59 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:59 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f8bee289-d965-487b-bdb1-a3bc2ab0252d" returned: 0 in 0.630s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:59 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'} {{(pid=87207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:14:59 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be11f2ef-8c49-4c92-be06-7f898dac1ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8bee289-d965-487b-bdb1-a3bc2ab0252d', 'volume_size': 1}' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e77a82-0dbf-4155-8371-8cfadfdea251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:59 devstack cinder-volume[87207]: INFO cinder.volume.flows.manager.create_volume [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Volume volume-f8bee289-d965-487b-bdb1-a3bc2ab0252d (f8bee289-d965-487b-bdb1-a3bc2ab0252d): created successfully Jul 06 21:14:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e77a82-0dbf-4155-8371-8cfadfdea251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87207) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:59 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Flow 'volume_create_manager' (86fef955-4e58-4d8d-91c1-fdedc7443cda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87207) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:14:59 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-ba2db6bf-65f0-447a-b39a-d0dde7aab017 tempest-ProjectReaderTests-1980588721 None] Created volume successfully. Jul 06 21:15:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] Acquiring lock "cinder-f8bee289-d965-487b-bdb1-a3bc2ab0252d-delete_volume" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:15:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] Lock "cinder-f8bee289-d965-487b-bdb1-a3bc2ab0252d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:15:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] Acquiring lock "cinder-quobyte-f8bee289-d965-487b-bdb1-a3bc2ab0252d" by "delete_volume" {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:15:00 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] Lock "cinder-quobyte-f8bee289-d965-487b-bdb1-a3bc2ab0252d" acquired by "delete_volume" :: waited 0.016s {{(pid=87207) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:15:00 devstack cinder-volume[87207]: DEBUG oslo.privsep.daemon [-] privsep: reply[309fe84d-1de6-4e0d-abd0-b9f98be02978]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:15:00 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f8bee289-d965-487b-bdb1-a3bc2ab0252d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:00 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f8bee289-d965-487b-bdb1-a3bc2ab0252d Jul 06 21:15:00 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:01 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f8bee289-d965-487b-bdb1-a3bc2ab0252d" returned: 0 in 0.734s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f8bee289-d965-487b-bdb1-a3bc2ab0252d {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:01 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f8bee289-d965-487b-bdb1-a3bc2ab0252d Jul 06 21:15:01 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:01 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb/volume-f8bee289-d965-487b-bdb1-a3bc2ab0252d" returned: 0 in 0.625s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:01 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] Lock "cinder-quobyte-f8bee289-d965-487b-bdb1-a3bc2ab0252d" released by "delete_volume" :: held 1.401s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:01 devstack cinder-volume[87207]: DEBUG cinder.quota [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] Created reservations ['4d79eaee-b5cd-417c-abe7-a0371dc3f276', 'a094d2f9-121d-428f-8c21-82d20e110ab1', 'b5d8d654-9518-4e66-af00-1e2ebf40a1f0', 'f556ce58-8b9f-4668-8427-f4f504478c33'] {{(pid=87207) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:15:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:15:01 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-07a6a206-87fa-46a0-9c0f-0b25dbf24a15'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:15:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:01 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:01 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb Jul 06 21:15:01 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:02 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:02 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8be5be4513ebc597f9b7a0bd7f3f3beb" returned: 0 in 0.649s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:02 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:15:02 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] Deleted volume successfully. Jul 06 21:15:02 devstack cinder-volume[87207]: DEBUG cinder.coordination [None req-7abeeba4-0101-4ab9-a815-9ef640fa06d3 tempest-ProjectReaderTests-1980588721 None] Lock "cinder-f8bee289-d965-487b-bdb1-a3bc2ab0252d-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=87207) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:12 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=43,cinder:UPDATE=73,cinder:INSERT=13,cinder:DELETE=8 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:15:12 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=42,cinder:UPDATE=60,cinder:INSERT=17,cinder:DELETE=4 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}